In a reasonably large village, it shouldn't be a problem - you can just move them to a different home.The number of villagers I've had to release and then murder because of personality mis-matches is more than I'd like to admit.
Seriously, spending all that time taming them, only to realize that they hate the personality of the person you specifically got them for, is quite annoying.
Also, maybe you should get that skill that allows you to know their personality in advance?