[Stable Diffusion] Prompt Sharing and Learning Thread

[Mr-Fox]

Does anyone have a tutorial on how to make a LyCORIS model?

I'm also interested in this. If you track down any good info source please share. With a search I found these links:

You must be registered to see the links

You must be registered to see the links

You must be registered to see the links

 

[me3]

In a basic sense it's not much different from training TI or Lora. Most of the difference is related to the optimizer and not really the "type".

I have found some odd behavior in training recently and i'm not sure what is causing it.
Since i've been testing alot of different values/settings i created a "base" file which i reloaded each time to reset things incase i'd accidentally update a setting etc. I ran multiple trainings on that base file to see that the results were the same each time, generated images had just the slight random nature you'd expect like strains of hair being slightly different etc.
After quite a while of testing i started seeing results that didn't make much sense so i retrained on just the base file and images generated was nowhere close to what they initially was. Character was suddenly 3x as old and at least twice the body weight. Have spent over a day now trying to get back to the starting point i have no idea what's "gone wrong". Nothing updated, training data has remained unchanged etc so somewhat confused.

Another thing i noticed is related to epoch settings.
With the base file i had the training thankfully only needed 1 epoch, IE the -000001 file generated using kohya-ss, but i had left the setting to run for 5 epochs just incases. When i changed this setting without changing anything else, the images generated on the trained file (still using the first epoch file) changed as well.
So i did multiple trainings with setting the "max epoch" to different values then generating images with the same seed using the 000001 file from each of those trainings.
So keep in mind, these image sets are ALL generated on using the 000001 file from trainings done on the exact same settings, same data etc, only thing that's changed is how many epochs the training would have run for. That is the number in the group titles, so where it say "ep_2" means it was set to run for 2 epochs, but it was still the first epoch file used to generated images.


This was repeatable too, so running the same generating on the same seed gave the same results so it isn't due to randomness in the generating. For some seeds the difference was much greater as well, IE one image would have just the clothing and not even the person, while wearing the same clothing in another.

I'm not sure if this is due to randomness in the optimzier (Prodigy) or if it's related to the scheduler (cosine) or if it's some kind of bug in the code.
It could be that the "cosine wave", to call it that, gets stretched from start to end, so that more epochs affects growth/decay, no idea tbh. Because it takes so long to test it i can't really look into it.
Regardless of the cause the result for "us" is that it can affect our training results and it's a value you'd not expect to do that besides when things stop.

 

[Mr-Fox]

In a basic sense it's not much different from training TI or Lora. Most of the difference is related to the optimizer and not really the "type".

I have found some odd behavior in training recently and i'm not sure what is causing it.
Since i've been testing alot of different values/settings i created a "base" file which i reloaded each time to reset things incase i'd accidentally update a setting etc. I ran multiple trainings on that base file to see that the results were the same each time, generated images had just the slight random nature you'd expect like strains of hair being slightly different etc.
After quite a while of testing i started seeing results that didn't make much sense so i retrained on just the base file and images generated was nowhere close to what they initially was. Character was suddenly 3x as old and at least twice the body weight. Have spent over a day now trying to get back to the starting point i have no idea what's "gone wrong". Nothing updated, training data has remained unchanged etc so somewhat confused.

Another thing i noticed is related to epoch settings.
With the base file i had the training thankfully only needed 1 epoch, IE the -000001 file generated using kohya-ss, but i had left the setting to run for 5 epochs just incases. When i changed this setting without changing anything else, the images generated on the trained file (still using the first epoch file) changed as well.
So i did multiple trainings with setting the "max epoch" to different values then generating images with the same seed using the 000001 file from each of those trainings.
So keep in mind, these image sets are ALL generated on using the 000001 file from trainings done on the exact same settings, same data etc, only thing that's changed is how many epochs the training would have run for. That is the number in the group titles, so where it say "ep_2" means it was set to run for 2 epochs, but it was still the first epoch file used to generated images.
View attachment 2746744

This was repeatable too, so running the same generating on the same seed gave the same results so it isn't due to randomness in the generating. For some seeds the difference was much greater as well, IE one image would have just the clothing and not even the person, while wearing the same clothing in another.

I'm not sure if this is due to randomness in the optimzier (Prodigy) or if it's related to the scheduler (cosine) or if it's some kind of bug in the code.
It could be that the "cosine wave", to call it that, gets stretched from start to end, so that more epochs affects growth/decay, no idea tbh. Because it takes so long to test it i can't really look into it.
Regardless of the cause the result for "us" is that it can affect our training results and it's a value you'd not expect to do that besides when things stop.

This was very useful information. Thank you!
The more we can reduce variables, the more control we'll have over the training and the end result.

 

[phraskito]

View attachment 2730286
A lovely snow white, fit for a prince!

Please, What model have you used?

 

[Mr-Fox]

Please, What model have you used?

cyberrealistic_v30. It's very easy to find out with PNG Info in SD Auto1111.

 

[FreakyHokage]

Does anyone have a tutorial on how to make a LyCORIS model?

You need the extension to use LyCORIS. Go here

You must be registered to see the links

click "code" and copy the link then go to the extensions tab on automatic1111 and click "Install from URL" paste the link under " URL for extension's git repository " and click apply and wait for it to install then click reload UI. All LyCORIS models go into your LoRA folder.

 

[sharlotte]

Please, What model have you used?

Mr Fox is correct. Usually I post the png with info, so if you run in 'PNG info' in SD tab, you'll be able to see all the prompts and settings used on my generated images. Here it is

You must be registered to see the links

There's a newer version since 3.1.

 

[maikijo]

Tell me, please, why is it so? I write in prompts "one person" or "1 person", but in the end, a lot of people still appear in the picture.

 

[Dagg0th]

Tell me, please, why is it so? I write in prompts "one person" or "1 person", but in the end, a lot of people still appear in the picture.

View attachment 2753073 View attachment 2753074

Your images are not valid or are edited, so I can't check what are your prompts to see what are you doing.

One probable cause is that you are using different width and height, try a 512x768

Put "1girl, solo", in positive, use weight if necessary, (1girl:1.5) for example.

 

[me3]

I was gonna post a grid showing of image repetition and epochs, just incase someone found it useful to just see how it changes.
I'd done 10 runs where each run had an increase in how many times the training images was repeated per epoch and did 10 epochs each.
Even compressing it down to jpg won't let me post it before it becomes too distorted (it's only 11k x 10k pix as well), so instead i'll break the thread rules and just post a one of the images from the trainings that i "lost" the file for and been unable to recreate. Prompt wouldn't help even me as the lycoris file is long gone so
Still, looks like a pretty nice boat/yacht though, bit out of focus

 

[Jimwalrus]

I was gonna post a grid showing of image repetition and epochs, just incase someone found it useful to just see how it changes.
I'd done 10 runs where each run had an increase in how many times the training images was repeated per epoch and did 10 epochs each.
Even compressing it down to jpg won't let me post it before it becomes too distorted (it's only 11k x 10k pix as well), so instead i'll break the thread rules and just post a one of the images from the trainings that i "lost" the file for and been unable to recreate. Prompt wouldn't help even me as the lycoris file is long gone so
Still, looks like a pretty nice boat/yacht though, bit out of focus
View attachment 2754060

What boat?
Oh, the motorboat...

 

[Sharinel]

I don't think that's cashmere but if I can just borrow it for a second or two I'll check for you

 

[Sepheyer]

Would anyone else feel embarrassed introducing her to your mom?

 

[me3]

Would anyone else feel embarrassed introducing her to your mom?

there is a slight chance i'd suggest something not quite that low cut
(assuming i could think that far...)

 

[Mr-Fox]

Tell me, please, why is it so? I write in prompts "one person" or "1 person", but in the end, a lot of people still appear in the picture.

View attachment 2753073 View attachment 2753074

You need to post the png file. You can find it in stable-diffusion-webui\outputs\txt2img-images, then the date it was generated.
Then we can see the generation data and better help you out. It's also against the thread guidelines to not include the prompt.
Don't worry no one is going to try rip you off or something stupid like that. The more info we have the better we can help.
Also it's the spirit and purpose of this thread to share prompts for learning purposes. We are very serious about not copying anyone else's work without giving proper credit etc.

 

[onyx]

Apologize if this is a repeat question, but is there a way to specify Girl A is Lora:X and Girl B is Lora:Y?

I'm trying to work backwards from this example (

You must be registered to see the links

):


Is there a way to base the rear girl off one Lora and the front off another, or does it just blend whatever models you add to the prompts?

 

[Sharinel]

Apologize if this is a repeat question, but is there a way to specify Girl A is Lora:X and Girl B is Lora:Y?

I'm trying to work backwards from this example (

You must be registered to see the links

):
View attachment 2755371

Is there a way to base the rear girl off one Lora and the front off another, or does it just blend whatever models you add to the prompts?

Yeah you can use something like Regional Prompter (there's a really good overview of it on the github page)

You must be registered to see the links

So you could have a prompt similar to :-

2 people on a couch in a living room
BREAK One girl with Lora A
BREAK One girl with Lora B

 

[FreakyHokage]

You need the extension to use LyCORIS. Go here

You must be registered to see the links

click "code" and copy the link then go to the extensions tab on automatic1111 and click "Install from URL" paste the link under " URL for extension's git repository " and click apply and wait for it to install then click reload UI. All LyCORIS models go into your LoRA folder.

Yeah, I completely miss read the comment lol. I thought they were asking how to use LyCORIS not make a LyCORIS lol

 

[Mr-Fox]

Yeah, I completely miss read the comment lol. I thought they were asking how to use LyCORIS not make a LyCORIS lol

Don't worry about it, you gave good info. It will without a doubt help someone.

 

[me3]

First of all i've never used Comfyui before so probably a lot of basics done horribly wrong, even more than usual.
Second, never used SDXL so no idea how prompting differs.
But it was the only thing i could get the model to even load in without OOM so needs must...
So with the ideal situation of using multiple unknowns i don't really no if the base model is working correctly, the UI setup is even remotely behaving well, nor if the refiner being applied in any way close to what it's meant to.

So here some test images, base and refiner "pairs"...




just a base image to show that there still seem to be an issue with multiple subjects (didn't try to fix it with just prompts) the rest of the image didn't seem too bad thought.