Wikipedia

File:Algorithmically-generated landscape artwork of forest with Shinto shrine using negative prompt for green trees.png

Original file ‎(4,096 × 2,048 pixels, file size: 6.49 MB, MIME type: image/png)

Summary

Description

Demonstration of the usage of negative prompting on algorithmically-generated artworks created using the Stable Diffusion V1-4 AI diffusion model. The purpose of a negative prompt is to instruct the AI to omit certain objects, motifs or visual elements when generating an image, as opposed to a positive prompt which instructs the AI to include such things.

This image aims to illustrate the process in which negative prompting within Stable Diffusion can be used to fine-tune the output of an AI generated image based on the desires of the user, as one part out of three images showing each step of the procedure.

Procedure/Methodology

All artworks created using a single NVIDIA RTX 3090. Front-end used for the entire generation process is Stable Diffusion web UI created by AUTOMATIC1111.

A single 768x512 image was generated with txt2img using the following prompts:

Prompt: Hakurei Shrine in distance, Gensokyo, nature landscape, landscape art, far view from distance, traditional Japanese architecture in distance, Shinto shrine in distance, forests, mountains, rivers, art style of Craig Mullins and jordan grimmer and tyler edlin and darek zabrocki and raphael lacoste

Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 1411213889, Size: 768x512

From there, two additional images were generated using the same seed and positive prompt, however this time using negative prompts:

Second image

Prompt: Hakurei Shrine in distance, Gensokyo, nature landscape, landscape art, far view from distance, traditional Japanese architecture in distance, Shinto shrine in distance, forests, mountains, rivers, art style of Craig Mullins and jordan grimmer and tyler edlin and darek zabrocki and raphael lacoste

Negative prompt: green trees

Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 1411213889, Size: 768x512

Third image

Prompt: Hakurei Shrine in distance, Gensokyo, nature landscape, landscape art, far view from distance, traditional Japanese architecture in distance, Shinto shrine in distance, forests, mountains, rivers, art style of Craig Mullins and jordan grimmer and tyler edlin and darek zabrocki and raphael lacoste

Negative prompt: round stones, round rocks

Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 1411213889, Size: 768x512

Afterwards, for all three images, the image was extended by 128 pixels on both the left and right sides using a single pass of the "Outpainting mk2" script within img2img. This was done using the same seed value of 1411213889 earlier, along with a setting of 100 sampling steps with Euler a, denoising strength of 0.8, CFG scale of 7, mask blur of 25, fall-off exponent value of 1.8, colour variation set to 0.03. The prompts used were identical to those utilised during the first step. This subsequently increases the image's dimensions to 1024x512, while also revealing additional foilage and architectural elements which were previously absent from the original AI-generated image.

Then, two passes of the SD upscale script using "Real-ESRGAN 4x plus anime 6B" were run within img2img. The first pass used a tile overlap of 64, denoising strength of 0.3, 50 sampling steps with Euler a, and a CFG scale of 7, using an identical seed of 482112941 for all three images. The second pass used a tile overlap of 128, denoising strength of 0.1, 30 sampling steps with Euler a, and a CFG scale of 7, using an identical seed of 3320472043 for all three images.
Date September 29, 2022
Source Own work
Author Benlisquare
Permission
(Reusing this file)
Output images

As the creator of the output images, I release this image under the licence displayed within the template below.

Stable Diffusion AI model

The Stable Diffusion AI model is released under the CreativeML OpenRAIL-M License, which "does not impose any restrictions on reuse, distribution, commercialization, adaptation" as long as the model is not being intentionally used to cause harm to individuals, for instance, to deliberately mislead or deceive, and the authors of the AI models claim no rights over any image outputs generated, as stipulated by the license.

Addendum on datasets used to teach AI neural networks
Artworks generated by Stable Diffusion are algorithmically created based on the AI diffusion model's neural network as a result of learning from various datasets; the algorithm does not use preexisting images from the dataset to create the new image. Ergo, generated artworks cannot be considered derivative works of components from within the original dataset, nor can any coincidental resemblance to any particular artist's drawing style fall foul of de minimis. While an artist can claim copyright over individual works, they cannot claim copyright over mere resemblance over an artistic drawing or painting style. In simpler terms, Vincent van Gogh can claim copyright to The Starry Night, however he cannot claim copyright to a picture of a T-34 tank painted with similar brushstroke styles as Gogh's The Starry Night created by someone else.
Other versions
Without any negative prompt
Using negative prompt "green trees"
Using negative prompt "round stones, round rocks"

Licensing

I, the copyright holder of this work, hereby publish it under the following licenses:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
GNU head Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled GNU Free Documentation License.
You may select the license of your choice.

Captions

Add a one-line explanation of what this file represents

Items portrayed in this file

depicts

MIME type

image/png

checksum

e88aeba18464c0ee5acc16492284a12ed83714ba

determination method: SHA-1

data size

6,804,477 byte

height

2,048 pixel

width

4,096 pixel

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current05:50, 29 September 2022Thumbnail for version as of 05:50, 29 September 20224,096 × 2,048 (6.49 MB)Benlisquare{{Information |Description=Demonstration of the usage of negative prompting on algorithmically-generated artworks created using the [https://github.com/CompVis/stable-diffusion Stable Diffusion V1-4] AI diffusion model. The purpose of a negative prompt is to instruct the AI to omit certain objects, motifs or visual elements when generating an image, as opposed to a positive prompt which instructs the AI to include such things. This image aims to illustrate the process in which negative promp...
The following pages on the English Wikipedia use this file (pages on other projects are not listed):

Global file usage

The following other wikis use this file:

Retrieved from "https://en.wikipedia.org/wiki/File:Algorithmically-generated_landscape_artwork_of_forest_with_Shinto_shrine_using_negative_prompt_for_green_trees.png"