[Stable Diffusion] Prompt Sharing and Learning Thread

felldude

Active Member
Aug 26, 2017
572
1,671


ComfyUI_00323_.png

Tested at 1280x1536 locally on 8GB video card, using the
NF4 is still faster for me but the lack of LORA support makes it useless.

This image took me 263 seconds on a RTX 3050 (20 Iterations)
 

felldude

Active Member
Aug 26, 2017
572
1,671

This is a dataset prepared for FLUX assuming Civitai adds TE training
But I tested it via PONY, along with my other BLIP-2 model it has a fair grasp of natural language.

ComfyUI_00087_.png ComfyUI_00091_.png
 
  • Like
Reactions: VanMortis

Fuchsschweif

Well-Known Member
Sep 24, 2019
1,107
1,778
Stable Diffusion seems to be stuck in a progress-crisis. After the first initial huge leaps forward there's not much happening right now.. we still need too many external things to get basic stuff done.
 
  • Like
Reactions: Sepheyer

Ashira13

Active Member
Jan 31, 2024
614
1,007
An example of working with SDXL Lightning checkpoints with refiner and various Loras plus HiresFix. : Model : , Refiner :

1726599615274.png
 

felldude

Active Member
Aug 26, 2017
572
1,671
Stable Diffusion seems to be stuck in a progress-crisis. After the first initial huge leaps forward there's not much happening right now.. we still need too many external things to get basic stuff done.
It comes down to basic math, you take the number of parameters by the data storage type.
Without quantization and data parallelism we wouldn't be using the size models we are.

No one has bothered to do it but a NF4 or Q4_0 model of SDXL should be around 2-3GB
 

Fuchsschweif

Well-Known Member
Sep 24, 2019
1,107
1,778
It comes down to basic math, you take the number of parameters by the data storage type.
Without quantization and data parallelism we wouldn't be using the size models we are.

No one has bothered to do it but a NF4 or Q4_0 model of SDXL should be around 2-3GB
4cec8db6-0cda-4567-ba1d-f094e1db3306.jpg

(I have no idea what you're talking about)
 
  • Haha
Reactions: CBTWizard

Fuchsschweif

Well-Known Member
Sep 24, 2019
1,107
1,778
We are reaching the limits of reducing the blocks size down without massive data loss.

Chat GPT is thought to have 1 trillion parameters without some form of reducing the size that would take 14 Terabytes of VRAM to train
That's really cool! Meanwhile my Stable Diffusion can't do hands or feet properly, no penetration, leave alone two normally functioning people in one image, and when I specify I want a "ghost girl" I always have bedsheet-ghosts in the background.

"Hairy pussy" often ends up with a complete half-human-half-ape creature.

I can't wait until Stable Diffusion finds out about its technological progress :KEK:
 
  • Like
Reactions: Sepheyer

felldude

Active Member
Aug 26, 2017
572
1,671
That's really cool! Meanwhile my Stable Diffusion can't do hands or feet properly, no penetration, leave alone two normally functioning people in one image, and when I specify I want a "ghost girl" I always have bedsheet-ghosts in the background.

"Hairy pussy" often ends up with a complete half-human-half-ape creature.

I can't wait until Stable Diffusion finds out about its technological progress :KEK:
One of the many finetunes of PONY would likely be a better fit for what your asking.
 

Fuchsschweif

Well-Known Member
Sep 24, 2019
1,107
1,778
you only have it set at 0.6 your up-scaling a 512x512, pony works best at 1024x1024
Your trying to use XL vae with PONY
I tried 1024x1024 too, didn't get better.. and the VAE is the one that was directly linked on the page of this SDXL Pony 6 checkpoint. Is it wrong? Here's the 1024x1024 result.
 

felldude

Active Member
Aug 26, 2017
572
1,671
I tried 1024x1024 too, didn't get better.. and the VAE is the one that was directly linked on the page of this SDXL Pony 6 checkpoint. Is it wrong? Here's the 1024x1024 result.
You might try one of the other PONY models that suites your taste.

This is my merge result same seed. With different prompts

ComfyUI_00169_.png

Sexy Ghost is not an easy prompt though

ComfyUI_00171_.png
 

Fuchsschweif

Well-Known Member
Sep 24, 2019
1,107
1,778
You might try one of the other PONY models that suites your taste.
I usually work with Dreamshaper 8 which puts out good content. But I can' get Pony to run, it always looks as bad as my previous images. Obviously, something must be wrong with my settings but what?
 

felldude

Active Member
Aug 26, 2017
572
1,671
I usually work with Dreamshaper 8 which puts out good content. But I can' get Pony to run, it always looks as bad as my previous images. Obviously, something must be wrong with my settings but what?
Load one of my images with any PONY model and see if the results get better
 

Sharinel

Active Member
Dec 23, 2018
569
2,349
I usually work with Dreamshaper 8 which puts out good content. But I can' get Pony to run, it always looks as bad as my previous images. Obviously, something must be wrong with my settings but what?
Are you putting the score_9, score_8_up shit in the prompt? Otherwise it looks like a cartoon animal having a seizure
 
  • Haha
Reactions: DD3DD

Sharinel

Active Member
Dec 23, 2018
569
2,349
No didn't do it, is it mandatory? Why all these different numbers?
Yeah it's mandatory. The absolute madlad who made the model intended it to be a complete rework of SDXL but was a bit too... intense. So it takes different inputs to really get it working good. Here's what I have as a style that I use with every pony pic

Additional prompts (paste at start of prompt) - score_9, score_8_up, score_7_up,
Addition negative prompts - score_6_up, score_5_up, score_4_up

He also used a prompting tag group called Danbooru, have a look here for the words to put in your prompts, especially for NSFW concepts.



Example - Here's a pic I just generated with the prompts above on a pony model
00147-4058343064.png

And here it is without any of the pony word-salad in the prompts/neg prompts. Same seed etc. Both of these are png files if you want to pop them in the png infor tab and have a look.

00162-4058343064.png