Nobody will track properly that many girls , it's not a matter of hiring help , even if it would likely be better . Unless you give a turn to a different girl each scene , they'll never get proper airtime , and if you do that the progression stops and they all feel irrelevant . It should have been obvious that it's impossible to juggle from the early days of the game , when there were "72 hours" days ingame lol .
Remember the MC having dates with 4-5 girls in a single night , each like at least one hour , while traveling from one location the next , even taking walks with family members ... or right in the midst of moving houses ? That's exactly what having so many in a harem does to your game .
The "big harem power fantasy" that do it right (like again , but mostly because fresh for me , "The long Road Home") still got less people within the game , and add those characters at a more controlled pace . Meaning you can actually name everyone and eventually care about them , or at least remember them . Yet even those good games suffer at times , from their MC having some weirdly intense "CEO/Mayor of a city" schedule