[Stable Diffusion] Prompt Sharing and Learning Thread

Sepheyer

Well-Known Member
Dec 21, 2020
1,571
3,768
Morning jog in the park. Shake shake shake..

View attachment 3249412 View attachment 3249413

I think I should explain. For a long time now I have been experimenting with mixing styles by using a lora that is anime or cartoon oriented with a photo realism checkpoint. Getting the extreme shapes and stylized look but with more realism. Lately, for a while I have been experimenting with using the refiner function in the same way. Meaning that I use a cartoon ckpt as the main ckpt and a photo realistic as refiner but I set the switch to happen earlier 0.3-0.5. This way I can achieve the same. However I seem to have found the limit of this concept. Doing a full body shot doesn't get me great result. Then I upscale in img2img with the photo realistic ckpt because hires fix doesn't work well with this process. I guess the alternative is to do something in img2img with controlnet to convert the comic/cartoon image into realism.

Why complicate things this much?

why the hell not?..
It's fun to experiment and try to push the envelope. This is what gives me the most enjoyment.

Example:

Without realistic "refiner"With realistic "refiner" (0.4), and a faceswap (Jenna Jameson).
View attachment 3249464 View attachment 3249459
Indeed, i2i is the way for all kinds of shenanigans. I am still on SD kick, can't really wrap my head around SDXL - hence I use HS2 outrageous proportions and then i2i them into realistic using tile controlnet at around 80-90% strength:


Dunno if you've tried it yet, but if you need the motivation, then just do it. That fucker took my breath away. I compared it against depth and canny controlnets, and tile is by far the best.
 

Mr-Fox

Well-Known Member
Jan 24, 2020
1,401
3,802
Indeed, i2i is the way for all kinds of shenanigans. I am still on SD kick, can't really wrap my head around SDXL - hence I use HS2 outrageous proportions and then i2i them into realistic using tile controlnet at around 80-90% strength:

Dunno if you've tried it yet, but if you need the motivation, then just do it. That fucker took my breath away. I compared it against depth and canny controlnets, and tile is by far the best.
I have only experimented a little with using img2img for converting cartoon to realism but I'm on it now. I was really not happy with the result I got with Jasmine. I have had much better success with other images before so it's a valid method, just not for everything. As is usually the case with everything regarding SD.

Here's a couple different examples of using the refiner method:
00018-3843319048.png 00019-2033577264.png 00020-3417485749.png
( pirsusComicsStyle_hardStyle and refiner: photon_v1 switch 0.4)

You have been a naughty naughty girl... I'll go get the paddel..
giggidy.. :D :LOL:
 
Last edited:

Dagg0th

Member
Jan 20, 2022
281
2,765
I have only experimented a little with using img2img for converting cartoon to realism but I'm on it now. I was really not happy with the result I got with Jasmine. I have had much better success with other images before so it's a valid method, just not for everything. As is usually the case with everything regarding SD.

Here's a couple different examples of using the refiner method:
View attachment 3249526 View attachment 3249539 View attachment 3249540
( pirsusComicsStyle_hardStyle and refiner: photon_v1 switch 0.4)

You have been a naughty naughty girl... I'll go get the paddel..
giggidy.. :D :LOL:
There is a LoRa that convert cartoonish images in t2i to 2.5D, after that it should be more easy to convert to realistic in i2i, that's the trick I used to make some hentai porn into realistic.
https://f95zone.to/threads/ai-art-show-us-your-ai-skill-no-teens.138575/post-11541639

I'm trying to find the Lora, but I think I already deleted it...

EDIT:
found it


Another trick is to create the cartoonish image, then HiRes it with a realistic model
00034-2754183384.png

00033-2754183384.png

after that, you can i2m for more realism I guess, more and more until it leaves the monitor for being hyperrealistic and comes back to life

BTW
Refiner never worked for me, don't even bother to use it anymore.
 
Last edited:
  • Like
Reactions: devilkkw and Mr-Fox

Mr-Fox

Well-Known Member
Jan 24, 2020
1,401
3,802
There is a LoRa that convert cartoonish images in t2i to 2.5D, after that it should be more easy to convert to realistic in i2i, that's the trick I used to make some hentai porn into realistic.
https://f95zone.to/threads/ai-art-show-us-your-ai-skill-no-teens.138575/post-11541639

I'm trying to find the Lora, but I think I already deleted it...

EDIT:
found it


Another trick is to create the cartoonish image, then HiRes it with a realistic model
View attachment 3249746

View attachment 3249747

after that, you can i2m for more realism I guess, more and more until it leaves the monitor for being hyperrealistic and comes back to life

BTW
Refiner never worked for me, don't even bother to use it anymore.
What do you mean by "hires it" ? Are you generating a cartoon image and then use it in controlnet lineart or similar with realistic ckpt? Or do you mean that you upscale with a realistic ckpt in img2img? :unsure:

When I'm talking about refiner, I mean I use SD1.5 models and use a cartoon style for the stylized look and the extreme shapes and with refiner get more details and realism. The "trick" is to switch early.
I never use refiner for SDXL models though as it was first intended.
 
Last edited:
  • Like
Reactions: Sepheyer

Sepheyer

Well-Known Member
Dec 21, 2020
1,571
3,768
What do you mean by "hires it" ? Are you generating a cartoon image and then use it in controlnet lineart or similar with realistic ckpt? Or do you mean that you upscale with a realistic ckpt in img2img? :unsure:

When I'm talking about refiner, I mean I use SD1.5 models and use a cartoon style for the stylized look and the extreme shapes and with refiner get more details and realism. The "trick" is to switch early.
I never use refiner for SDXL models though as it was first intended.
Yea, ComfyUI makes it very easy to first render a cartoon with outsized proportions, then pull realistic on it. I used to do it, and then realized that HS2 lofi renders works just as good as a cartoon but gives more control.
 
  • Like
Reactions: Mr-Fox

Mr-Fox

Well-Known Member
Jan 24, 2020
1,401
3,802
Yea, ComfyUI makes it very easy to first render a cartoon with outsized proportions, then pull realistic on it. I used to do it, and then realized that HS2 lofi renders works just as good as a cartoon but gives more control.
I was looking at his image in png info to re-engineer what he was talking about and saw he is using a different extension that allows a pos and neg prompt. I simply use hiresfix. I tried kohya hiresfix but didn't like it as it completely changes the image composition and also added some unwanted strange visuals. I was not aware of this hires extension.
 
  • Like
Reactions: Sepheyer

me3

Member
Dec 31, 2016
316
708
Not really been getting the "cooperation" i'd like from the AI with this, loads of elements it either doesn't want to include or it turns them into an extra leg or arm for some reason...
Since it doesn't want to do both the pants/salvar and a see through "skirt" i guess we're sticking with the see through, less is more right...
Headband becomes a tiara, but probably not where eyes are going anyway. At least the hair is at a fairly correct length
Prompt is 99% from a wd14 caption, which i guess could be some of the problem. Probably shouldn't look too closely or count things ;)
jasmine_0001.png

You don't have permission to view the spoiler content. Log in or register now.
 
  • Like
Reactions: Sepheyer

Dagg0th

Member
Jan 20, 2022
281
2,765
What do you mean by "hires it" ? Are you generating a cartoon image and then use it in controlnet lineart or similar with realistic ckpt? Or do you mean that you upscale with a realistic ckpt in img2img? :unsure:

When I'm talking about refiner, I mean I use SD1.5 models and use a cartoon style for the stylized look and the extreme shapes and with refiner get more details and realism. The "trick" is to switch early.
I never use refiner for SDXL models though as it was first intended.
What I mean is that in A1111 you can hi.Res using another chkpnt.
Probably it need to be enabled settings, you can add more prompt for Hi.Res and add more realistic tokens, previously unavailable in cartoonish chkpnts.
Screenshot_3.jpg
 

Delambo

Newbie
Jan 10, 2018
99
89
Man, I'm struggling to get anything I want in ComfyUI. Does anyone have a half way decent image of a 2 character sex pose that I can look over the workflow of?
 

namhoang909

Newbie
Apr 22, 2017
87
48
I have tested using hiresfix with a different ckpt that is realism oriented as the eminent Dagg0th posted about.
Then I did some fixes with inpaint and a small edit in photoshop and then upscaled it.
A little "cheating" but not that much. :D

View attachment 3253671
:oops: look at those perfect fingers
Question:
I saw there are Ydetailer and DDetailer which replace Adetailer in ComfyUI, which one is better?
I have 3060 with 12gb vram, will that work for SDXL models? I want to generate and up-scale images, ..(post processing) not training.
Here is , I haven't found the Ydetailer download link though.
 
  • Like
Reactions: Mr-Fox

sharlotte

Member
Jan 10, 2019
303
1,606
Have not tried either in Comfy so cannot tell you.
As for SDXL, sure i've got the 3060 as well and there's no issue. In CUI it's running super fast Here some of the pics I generated yesterday just for a change from ladies ComfyUI_00019_.png ComfyUI_00020_.png ComfyUI_00022_.png

. In A1111, it's a bit slower, especially if you use controlnet, hires, adetailer at the same time but it's working fine.
 

Synalon

Member
Jan 31, 2022
225
663
I've been trying to get some kind of "cabaret stage" type background on this for a day or two now, anybody else want to try?

Cabaret Girl Midas.jpg
 
  • Like
Reactions: Sepheyer

devilkkw

Member
Mar 17, 2021
324
1,094
I've been trying to get some kind of "cabaret stage" type background on this for a day or two now, anybody else want to try?

View attachment 3256695
I'll try with some other evenet's, but without using as background, it give me good result.
Prompt is simply: subject, type, perfoming on American got talent.
This is the base prompt, one exemple is: blonde braid haired woman, singer, performing on American got talent.
Also try some other most know show (the voice for example) and seem work well.
 
  • Like
Reactions: Mr-Fox