The game seems pretty limited in terms of being able to tell who's related to who. It doesn't keep track of grandchildren, for instance. I encountered a weird case where one of my sons saw his daughter as his sister despite them not being related other than father and daughter simply because she was also one of his half brother's half sister.