[Stable Diffusion] Prompt Sharing and Learning Thread

[me3]

Combining loras or similar things, often causes conflicts like oversaturated colors, disfiguring etc mostly cause they are poorly trained or you are using ones that are specifically made to target the same thing.
Generally you should be pretty safe to use lora/TI/etc at 1 or close to it on it's own, the further away from 1 you need to apply it the more poorly trained it is (not the case for more general styling though where weight is more how "hard" you want it to apply, IE dim lighting).
If you have a lora that you need to drop to as low as 0.2 you more than likely have a perfect example of something that should just be deleted and trained again.
You can use weighting to figure out how to adjust you train as well, think of it as value to apply to your learning rates (or epoch/repetitions), for lycoris this gets even more accurate as you can adjust weight for both values and make it easier to adjust both learning rates.

And now, something completely different...

 

[Mr-Fox]

Combining loras or similar things, often causes conflicts like oversaturated colors, disfiguring etc mostly cause they are poorly trained or you are using ones that are specifically made to target the same thing.
Generally you should be pretty safe to use lora/TI/etc at 1 or close to it on it's own, the further away from 1 you need to apply it the more poorly trained it is (not the case for more general styling though where weight is more how "hard" you want it to apply, IE dim lighting).
If you have a lora that you need to drop to as low as 0.2 you more than likely have a perfect example of something that should just be deleted and trained again.
You can use weighting to figure out how to adjust you train as well, think of it as value to apply to your learning rates (or epoch/repetitions), for lycoris this gets even more accurate as you can adjust weight for both values and make it easier to adjust both learning rates.

And now, something completely different...
View attachment 2732739

Aww look how cute I am.. That's exactly how I look each morning getting my first sip of joe..

 

[Mr-Fox]

Cheers!

 

[HardcoreCuddler]

Aww look how cute I am.. That's exactly how I look each morning getting my first sip of joe..

you seem a little...young for this place lol

 

[Mr-Fox]

you seem a little...young for this place lol

But it only seems that way. Little do you know that I'm only small and cute on the outside but old, mean and twisted on the inside... muahhaha

 

[sharlotte]

Like a fox in a hen house (the teeth are a bit much ):

 

[Sepheyer]

Language Models

Want AI to write you porn stories? While being completely uncensored, self-guided, using desktop install, and running on a potatoo PC?

Here is the quickest no-frustration guide that will have you running right away:

1. You must be registered to see the links
   - go with "One-click installer" for your OS. Save the zip to the like of: "D:\LMs\oobabooga" and then run the install batch file. Once the install completes you will have an equivalent of A1111 webui installed in the folder from which the batch file was run.
2. You must be registered to see the links
   . Grab the "guanaco-7B.ggmlv3.q4_1.bin" file, that's the actual model, and save it inside "..\oobabooga\text-generation-webui\models".

That's all you need.

Housekeeping regarding settings:

1. Go to tab "Parameters", set "max_new_tokens" to the very max. As of today, the fresh install comes with max of 2000.
2. Go to tab "Chat settings", then subtab "Instruction Template", choose "guanaco non-chat".
3. Go to tab "Text generation", input field, and then: "Write a script for the red riding hood porn film." and watch the magic happen.

PS Also, a relevant video driving the point of why the tokens are important and the race for increasing the token counts:

You must be registered to see the links

PS2 Here is how the LM described a red riding hood outfit for a porn movie that resulted in the picture below:

Spoiler: LM Output

You don't have permission to view the spoiler content. Log in or register now.

Spoiler: More

You don't have permission to view the spoiler content. Log in or register now.

 

[Mr-Fox]

View attachment 2733142

Language Models

Want AI to write you porn stories? While being completely uncensored, self-guided, using desktop install, and running on a potatoo PC?

Here is the quickest no-frustration guide that will have you running right away:

1. You must be registered to see the links
   - go with "One-click installer" for your OS. Save the zip to the like of: "D:\LMs\oobabooga" and then run the install batch file. Once the install completes you will have an equivalent of A1111 webui installed in the folder from which the batch file was run.
2. You must be registered to see the links
   . Grab the "guanaco-7B.ggmlv3.q4_1.bin" file, that's the actual model, and save it inside "..\oobabooga\text-generation-webui\models".

That's all you need.

Housekeeping regarding settings:

1. Go to tab "Parameters", set "max_new_tokens" to the very max. As of today, the fresh install comes with max of 2000.
2. Go to tab "Chat settings", then subtab "Instruction Template", choose "guanaco non-chat".
3. Go to tab "Text generation", input field, and then: "Write a script for the red riding hood porn film." and watch the magic happen.

PS Also, a relevant video driving the point of why the tokens are important and the race for increasing the token counts:

You must be registered to see the links

PS2 Here is how the LM described a red riding hood outfit for a porn movie that resulted in the picture below:

Spoiler: LM Output

You don't have permission to view the spoiler content. Log in or register now.

View attachment 2733228

Spoiler: More

You don't have permission to view the spoiler content. Log in or register now.

Great work, hot stuff.

 

[devilkkw]

I released a textual inversion For making realistic image from i2i.


If you interested just download

You must be registered to see the links

and follow instruction on civitai post.

 

[me3]

I released a textual inversion For making realistic image from i2i.
View attachment 2737561

If you interested just download

You must be registered to see the links

and follow instruction on civitai post.

I hope you weren't aiming for accuracy in the "conversion". Even if we ignore all the small details that is a pain at the best of times with AI generation, the large "missing" bits would strongly suggest there's work to be done.
IE, breast size, even in a less anime nature they are clearly way too small and "flat". As for the clothing, neck area has completely changed, abdomen area has its clothing removed and instead you have gotten "rendering discoloring" which looks like what you get from overtraining. Crotch area is completely different as well.
It might be due to an unfortunate choice of picture and/or model, but if that's the case it wasn't the smartest choice of marketing example

 

[me3]

...

View attachment 2733228

View attachment 2733238

You and "both" the AIs did a good job, but those two images happen to perfectly illustrate a problem i've been having as well.
Getting the AI to do (what we at least consider) basic things like "carry/hold item in hand" can be a real nightmare, and even if you get it sort of right it's usually in a very unnatural way. If the seed itself doesn't include it, you're looking at an endless battle. Having spent nearly 60 hours trying to get someone to hold a sword in a way that was even remotely looked natural, i'd rather look for a seed where it was included on its own and then "fight" to add the things that was "wrong" in that new seed...

 

[devilkkw]

I hope you weren't aiming for accuracy in the "conversion". Even if we ignore all the small details that is a pain at the best of times with AI generation, the large "missing" bits would strongly suggest there's work to be done.
IE, breast size, even in a less anime nature they are clearly way too small and "flat". As for the clothing, neck area has completely changed, abdomen area has its clothing removed and instead you have gotten "rendering discoloring" which looks like what you get from overtraining. Crotch area is completely different as well.
It might be due to an unfortunate choice of picture and/or model, but if that's the case it wasn't the smartest choice of marketing example

I know, and it don't keep so much details because denoise is high, for keeping detail i have to keep slow denoise. and on really flat image is not good. maybe working on different way but actually i'm unable to train lora, so my only way is Textual Inversion. Btw is a good start point to work better on it, i like constructive comment, thank you.

 

[me3]

I know, and it don't keep so much details because denoise is high, for keeping detail i have to keep slow denoise. and on really flat image is not good. maybe working on different way but actually i'm unable to train lora, so my only way is Textual Inversion. Btw is a good start point to work better on it, i like constructive comment, thank you.

if it's a vram concern, you shouldn't need that much more to train loras than TIs, i can train on 768x768 images with just a old 6gb card which works fine. It's slow but it works, it should be possible at even lower vram too.
Should give lycoris a try, depending on type you can create files almost as small as TIs, about 200kb, unlike loras that is much larger.
You can also adjust lycoris better in the prompts to better work out training issues and, eventually, better fit to the image you are converting.

 

[Mr-Fox]

You and "both" the AIs did a good job, but those two images happen to perfectly illustrate a problem i've been having as well.
Getting the AI to do (what we at least consider) basic things like "carry/hold item in hand" can be a real nightmare, and even if you get it sort of right it's usually in a very unnatural way. If the seed itself doesn't include it, you're looking at an endless battle. Having spent nearly 60 hours trying to get someone to hold a sword in a way that was even remotely looked natural, i'd rather look for a seed where it was included on its own and then "fight" to add the things that was "wrong" in that new seed...

You either need to train a Lora, TI's etc or use open pose with controllnet. Alternatively find an already existing Lora or TI's etc, but this is always with the hazard of getting a poorly trained one.

 

[Mr-Fox]

I know, and it don't keep so much details because denoise is high, for keeping detail i have to keep slow denoise. and on really flat image is not good. maybe working on different way but actually i'm unable to train lora, so my only way is Textual Inversion. Btw is a good start point to work better on it, i like constructive comment, thank you.

If you can do checkpoints and TI's you should definitely be able to train Lora's. I used kohya ss for mine, don't try to use Auto1111 for this.

You must be registered to see the links

(copy the settings of 59xed3 instead of Aitrepeneur).

Here's a very extensive guide about the actual training:

You must be registered to see the links

Also take a look at Schlongborn's awesome post about training his first Lora:
https://f95zone.to/threads/stable-diffusion-prompt-sharing-and-learning-thread.146036/post-10306324

 

[me3]

You either need to train a Lora, TI's etc or use open pose with controllnet.

Yeah i know, i'm still just very much in the "figure out what this thing can natively do" stage. I'm also of the kind that likes the challenge of trying to find ways/tricks/workarounds for things. It's also rather funny seeing all the "super amazing" lora/ti/models ppl say they've made to do stuff that models already know how. Having to resist the urge to ask/post "did you even test if the AI understood this first"

Currently down to about 15-20min training time on my current testing set, testing out which settings has any effect and "what". (4.8 s/it on an old worndown card). Might get that further down as it might be slightly overtrained, but i need to keep it constant for the moment to work out what other values/settings to use and hopefully be able to transfer much of that to other datasets. Problem with having such a slow setup is that by the time I have any meaningful results there's an update or a much better "something" and it's back to the beginning.

 

[devilkkw]

If you can do checkpoints and TI's you should definitely be able to train Lora's. I used kohya ss for mine, don't try to use Auto1111 for this.

You must be registered to see the links

(copy the settings of 59xed3 instead of Aitrepeneur).

Here's a very extensive guide about the actual training:

You must be registered to see the links

Also take a look at Schlongborn's awesome post about training his first Lora:
https://f95zone.to/threads/stable-diffusion-prompt-sharing-and-learning-thread.146036/post-10306324

I tested it time ago, by your older comment. i was unable to run it. maybe i see is update and giving it a new chance. thank for useful link.

 

[Mr-Fox]

I tested it time ago, by your older comment. i was unable to run it. maybe i see is update and giving it a new chance. thank for useful link.

I had problems at first also, I had to download "alternative cuda libraries" for my Pascal GPU and it solved it. I made a post about it. You probably needs something similar to make it work.
https://f95zone.to/threads/stable-diffusion-prompt-sharing-and-learning-thread.146036/post-10357013

 

[devilkkw]

I had problems at first also, I had to download "alternative cuda libraries" for my Pascal GPU and it solved it. I made a post about it. You probably needs something similar to make it work.
https://f95zone.to/threads/stable-diffusion-prompt-sharing-and-learning-thread.146036/post-10357013

Thank you so much, new version work and i'm able tu run it, now is time to try and make some test.

 

[PandaRepublic]

Does anyone have a tutorial on how to make a LyCORIS model?