Worked on same idea time ago, i see you are using high denoise, so the image change a lot.
This is made using only TI without any prompt, and a negative: (poor quality:1.2), featureless, lowres, monochrome, grayscale, bad proportions, ugly, doll, plastic_doll, silicone, anime, cartoon, fake, filter, airbrush, (kkw-ph-neg3:1.002), Asian, (fake), (3D), (render), (kkw-ultra-neg:1.005)
CFG:30- Denoise 0,28.
View attachment 2595813
Sampler you use in this type of work is important, DPM++ 2M Karras is good for realism, sometimes Heun work better.
Another trick is made image little lower res(like 8,10%), not as same resolution you want generate, but keep the ratio, so image is little upscaled in img2img and you get more details. Remember to select upscaler for img2img in config tab.
But what is your goal, keep image consistent or something other?