[Stable Diffusion] Prompt Sharing and Learning Thread

May 13, 2023
35
31
Stacking embeddings and loras will often screw things up for you as well. The more poorly done they are the more "wrong" things they affect. Just because it says it'll just give a hairstyle or clothing it very often causes impacts with other things.Which is why people should put much more effort into the job when training them, unfortunately many just go for the simple shortcut route and you get stuck wondering "WTF made that happen"
This is becoming an issue with Civitai, I'm afraid. I've noticed more and more Loras with someone going: this doesn't work well, LOL, which sort of raises the question: why are you putting it out there? I could see if someone asked: why it wasn't working, but a lot of them are just chucking stuff out there.

Imma drop here my first ~10 attempts using control net in ComfyUI. Finally got over my laziness and tried to see for myself what's up.
those are noice images! Great job!

i've been looking at Comfy UI, but I got my start on Automatic1111--so how is comfyUI? Does it give you more control?
 

Sepheyer

Well-Known Member
Dec 21, 2020
1,575
3,778
This is becoming an issue with Civitai, I'm afraid. I've noticed more and more Loras with someone going: this doesn't work well, LOL, which sort of raises the question: why are you putting it out there? I could see if someone asked: why it wasn't working, but a lot of them are just chucking stuff out there.


those are noice images! Great job!

i've been looking at Comfy UI, but I got my start on Automatic1111--so how is comfyUI? Does it give you more control?
A1111 has more features, but I switched to CUI because it let me do landscape-oriented images like this using its composing feature:

a_05676_.png

Then I stopped using landscape, but using CUI stayed as a habit.
 
  • Like
Reactions: FreakyHokage

Sepheyer

Well-Known Member
Dec 21, 2020
1,575
3,778
Holy smokin fudge on a stick.. That's just awesome. Great job. :D(y) I have been putting it of for a long time myself also but I very much intend to start messing with control net stuff as well.
Here a starter pack for the poses:

pose sholder wide 001.png pose arms behind head 022.png pose bent 001.jpg

Here is the tool I use to generate these:

Important: the defailt stickman comes with wide shoulders (~40 units), I change them down to 25 units. The prompt for the body-ratios appears when you click on a stickman's nodes.

Here daring Ms. Sanchez, the physics teacher, to do a split.

a_10737_.png
You don't have permission to view the spoiler content. Log in or register now.
 

Mr-Fox

Well-Known Member
Jan 24, 2020
1,401
3,804
Here a starter pack for the poses:

View attachment 2698581 View attachment 2698585 View attachment 2698586

Here is the tool I use to generate these:

Important: the defailt stickman comes with wide shoulders (~40 units), I change them down to 25 units. The prompt for the body-ratios appears when you click on a stickman's nodes.

Here daring Ms. Sanchez, the physics teacher, to do a split.

View attachment 2698578
You don't have permission to view the spoiler content. Log in or register now.
Thank you. Now that you are using the open pose editor, you might be interested in pose packs. There is a category for poses on civitai and there are other places as well. I found out about this long time ago and I have been meaning to try it out but haven't gotten around to it yet.


Examples:
1686839540821.png 1686839568047.png 1686839597182.png
Source:

Examples:
1686839793155.png 1686839861897.png 1686839886696.png
Source:

Examples:
1686840010611.png 1686840022666.png 1686840044305.png
Source:
 

Sepheyer

Well-Known Member
Dec 21, 2020
1,575
3,778
Thank you. Now that you are using the open pose editor, you might be interested in pose packs. There is a category for poses on civitai and there are other places as well. I found out about this long time ago and I have been meaning to try it out but haven't gotten around to it yet.


Examples:
View attachment 2699613 View attachment 2699626 View attachment 2699628
Source:

Examples:
View attachment 2699630 View attachment 2699636 View attachment 2699637
Source:

Examples:
View attachment 2699642 View attachment 2699643 View attachment 2699644
Source:
Thank you! I raided them hard!
 
  • Yay, update!
Reactions: Mr-Fox

me3

Member
Dec 31, 2016
316
708
Lycoris was mentioned and i was getting rather bored trying to beat the AI into understanding that skin come in a massive variance of tones and body parts can have very different "builds" on the same person...so far it's winning...

Grabbed the huge amount of 6 fairly low quality 20-30 year old photos and threw them at the AI. Some other things got thrown back, digging through it there was something that looked slightly similar. If anyone is able to identify it without cheating I guess there's some hope...
(considering the prompt is like <10 words total i guess a few things could have been fixed there)

00077-818029826.png

one of the training images is in the spoilerand the .safetensors should be attached, but be warned it has A LOT of issue, it's really touchy about sampler and seed, and i've only tested it for a few images on one model.
You don't have permission to view the spoiler content. Log in or register now.
 

Shadinx2

Newbie
Apr 19, 2020
16
10
Does anybody know how to merge LyCORIS models into a checkpoint? Even better, merge LyCORIS models together and I don't just mean normal LORA, I'm talking about the extended stuff.
 

Mr-Fox

Well-Known Member
Jan 24, 2020
1,401
3,804
Does anybody know how to merge LyCORIS models into a checkpoint? Even better, merge LyCORIS models together and I don't just mean normal LORA, I'm talking about the extended stuff.
You can merge Loras with kohya ss. I have tried it and it doesn't yield good results, at least not in my experience. Smashing things together is the shotgun approach and it never ends well. Merging Loras or Lycoris with a checkpoint is pointless. When we use them with a checkpoint it works and it's essentially the same thing. If you successfully merged a Lora or Lycoris then you would be stuck with it and not be able to change it very easily. I think these ideas are much more trouble than it would ever be worth. Sorry to smash your dreams..
 

FreakyHokage

Member
Sep 26, 2017
397
623
I did some of Vidia from the Tinker Bell movies :) I also did some of Lauren Cohan (Maggie - The Walking Dead) but I don't know the rules of the site for posting AI art of real people. I know it's against the TOS of other sites. If it's ok let me know and I'll post those as well.

If you want to know the prompts and settings I used just add the images to PNG info and it'll tell you. I use Automatic1111 00000-3492980353.jpeg
 

Mr-Fox

Well-Known Member
Jan 24, 2020
1,401
3,804
I did some of Vidia from the Tinker Bell movies :) I also did some of Lauren Cohan (Maggie - The Walking Dead) but I don't know the rules of the site for posting AI art of real people. I know it's against the TOS of other sites. If it's ok let me know and I'll post those as well.

If you want to know the prompts and settings I used just add the images to PNG info and it'll tell you. I use Automatic1111 View attachment 2702796
It's perfectly fine. Just try to avoid anything too young. We are trying to run a respectable establishment here.. :LOL:
Though seriously if you post anything that looks anything vaguely like CP I'll come at ya with a crowbar..
Other than this you're fine.:D(y) Nice job on the dark haired Tinkerbell. :love:
 

FreakyHokage

Member
Sep 26, 2017
397
623
It's perfectly fine. Just try to avoid anything too young. We are trying to run a respectable establishment here.. :LOL:
Though seriously if you post anything that looks anything vaguely like CP I'll come at ya with a crowbar..
Other than this you're fine.:D(y) Nice job on the dark haired Tinkerbell. :love:
wait? Dark-haired Tinkerbell? It's Vidia :LOL: Oh, and I won't post any shit like that ever.
 

me3

Member
Dec 31, 2016
316
708
Does anybody know how to merge LyCORIS models into a checkpoint? Even better, merge LyCORIS models together and I don't just mean normal LORA, I'm talking about the extended stuff.
It's more common to the opposite, at least earlier. They trained DB models (potentially others as well) then extracted the character from that into a lora/lycoris.
If you want different models in the same file you can just train it in one go, you can have multiple characters/objects in the same lora/lycoris using different trigger words.