The easiest way to get a consistent face is to introduce a LoRA to the model. There are tons of them out there free to DL. Doesn't take much expertise either. Just add, then prompt with the trigger word. Finding one that works with facegen shouldn't be difficult.