Tutorial Tool Others Stable Diffusion Setup Guide [Questianon]

[applecider212]

Hi guys, it's been a while since my last post. I finally finished my Stable Diffusion guide for Windows + NVIDIA setups. I hope you find everything you need in there to set up and use Stable Diffusion to its fullest:

You must be registered to see the links

What is Stable Diffusion and why should you care (copied from my poll post)?
Stable Diffusion is a new piece of software that can allow many more people to easily make artwork their games and/or improve their artworks through AI. All you have to do is write a prompt of what you want and you'll have your desired image as your output.

You can generate things from scenery to character art, and in the right hands, there are limitless capabilities. Here's an example of someone who used Stable Diffusion to generate a webcomic:

You must be registered to see the links

As of right now, the process is confusing and it's hard for a newcomer to find the right resources. Some guides feel too convoluted and everything is everywhere. However, I've been compiling a compendium of resources that I think will let anyone set up and use Stable Diffusion. This is especially directed toward game developers that lack the technical expertise or funding to get good art for their games and people that just want good art (and smut) but can't find any online.

Current goals:
Linux + AMD setups
More training information
Guides on integrating SD into your workflow

Socials:
Trip: questianon !!YbTGdICxQOw
Discord: malt#6065
Reddit: u/questianon
Github:

You must be registered to see the links

Twitter:

You must be registered to see the links

Donation Links:
All donations will be put back into creating resources for the community. Do not donate if you cannot afford it
Patreon:

You must be registered to see the links

Ko-fi:

You must be registered to see the links

Note: If there's anyone wrong with this post, comment it or send a DM so I can edit it. Thanks

 

[TheRealZeroEnergy]

Sorry to ask, but on your tutorial you didnt stated how much vram is needed to use Stable Diffusion, from what I research 12 vram is the minimum correct?

 

[x.utilitarian.x]

Sorry to ask, but on your tutorial you didnt stated how much vram is needed to use Stable Diffusion, from what I research 12 vram is the minimum correct?

if you use the --medvram or --lowvram switches you can get away with less. I'm doing 4 minutes for a 20 pass 512x512 image on 3gb. If I try going much bigger at all I run out of memory and it has to bet he only thing running.

I use --medvram and use the core automatic1111 repo with some scripts added from other ones, and a myriad of porny checkpoints. it is worth doing if you have the time and inclination


edit: I want to mention, I think this could be a great tool for folks wanting to make games.

TRAINING a model, which is what you want to do for actual customization takes at least 6gb based on reports, but is unstable with less than 8. per the reddit communit.

 

[Qwert99]

I hope the 5 minutes to install thing was just a joke. Been at this for 3 hours trying to troubleshoot shit and it still isn't working. Now the webui.bat can't seem to find the specific version of torch online when trying to install it and I've no idea what to get or where to put it or what to do with it so I'm completely stuck.

 

[applecider212]

I hope the 5 minutes to install thing was just a joke.

No, the 5 minutes thing is legitimate. The last two times I installed fresh copies of the webui took ~5-10 minutes since I already had the models installed on my computer. So far, my guide only covers Windows + NVIDIA, though I'll be adding Linux, Apple, and AMD eventually.

Now the webui.bat can't seem to find the specific version of torch online when trying to install it and I've no idea what to get or where to put it or what to do with it so I'm completely stuck.

For troubleshooting:
- Are you running webui-user.bat (not webui.bat)? It should install everything on the first run.
- The torch thing might be a bug, you might have to download the correct version of torch yourself and put it in your stable-diffusion-webui/venv/Lib/site-packages folder. Otherwise, webui-user.bat should install it for you

from what I research 12 vram is the minimum correct?

That was the case in the past. Now you can go as low as 2GB vram (I believe) or use CPU to run webui, though the generations might take minutes instead of seconds.

if you use the --medvram or --lowvram switches you can get away with less.

You can also use `--opt-split-attention` and/or `--always-batch-cond-uncond` (in order of which you should use first) for even less vram usage.

 

[TheRealZeroEnergy]

Hey, dunno if you can help but I have two questions, I have been using Invoke AI recently and tried to make some nsfw art with characters like Uraraka but only managed to make her naked (no actual sex) and I can't find a way on the internet on how to train my own model, basically I have my own folder with nsfw art and want to make a model based on that folder, any ideas?

 

[Kryptozoid]

Hey, dunno if you can help but I have two questions, I have been using Invoke AI recently and tried to make some nsfw art with characters like Uraraka but only managed to make her naked (no actual sex) and I can't find a way on the internet on how to train my own model, basically I have my own folder with nsfw art and want to make a model based on that folder, any ideas?

Can't explain anything related to InvokeAI cause I use Auto1111, I also can't explain how to train a full model (but I know it involves days/weeks of work and a Gigachad GPU). But if your main goal is just to make porn of a specific character, then just download a model specialised in nsfw stuff like the variations of NovelAI for anime stuff or URPM, or Hassan Blend for realistic style.
You can find plenty on Civitai.

Lastly if you want to use a specific person/character, you just need 50 to 120 pics of it, all cropped 512x512, and then find a tutorial on how to do embeddings. If you have a good GPU, once you have your dataset, it takes around 35mn to train, it results in small file around 10Ko that you put in the "embedding" folder (in Auto1111 at least, but must be similar in Invoke) and let's say you made a Zangief.pt file, when you'll type Zangief in your prompt it will know who is Zangief.

There's also the Dreambooth method, or the new Loras method which give better results, but are more complex to do. And honestly embeddings are pretty good once you know how to make a good dataset.

 

[TheRealZeroEnergy]

Can't explain anything related to InvokeAI cause I use Auto1111, I also can't explain how to train a full model (but I know it involves days/weeks of work and a Gigachad GPU). But if your main goal is just to make porn of a specific character, then just download a model specialised in nsfw stuff like the variations of NovelAI for anime stuff or URPM, or Hassan Blend for realistic style.
You can find plenty on Civitai.

Lastly if you want to use a specific person/character, you just need 50 to 120 pics of it, all cropped 512x512, and then find a tutorial on how to do embeddings. If you have a good GPU, once you have your dataset, it takes around 35mn to train, it results in small file around 10Ko that you put in the "embedding" folder (in Auto1111 at least, but must be similar in Invoke) and let's say you made a Zangief.pt file, when you'll type Zangief in your prompt it will know who is Zangief.

There's also the Dreambooth method, or the new Loras method which give better results, but are more complex to do. And honestly embeddings are pretty good once you know how to make a good dataset.

Yeah, tried the dreambooth but my gpu is not strong enough, Im gonna take a look at the embeddings method, thanks

 

[Kryptozoid]

Good luck, but probably abandon all hope if you only have 6GB VRAM (or maybe it works with a lot of configuration but it will be slow as hell and limited in various aspects).