Oh, one thing that I noticed when using ADetailer that sometimes it picks up characters that are in the background or like paintings on the wall that have faces in them. If you go to "Detection", Detection model confidence threshold is set to 0.3 by default. That easily picks up other faces if you have them in picture so I usually set it to 0.8 or more.
True true true, since we're sharing knowledge, another tiny bit about aDetailer:
if you match more than one face and want to apply different prompts to each, you can just use the keyword SEP in aDetailer 's specific prompt, it will apply them in order.
e.g. "Blu piercing eyes, heavy make-up, freekles, SEP, Green Eyes, blue lipstick, skin pores"
If aDetailer detects 2 faces, the first part of the prompt will be used for 1st face inpaint, the second part, after SEP, for the others.