1 to 3 is enough, 5 is a bit much but still controlable, and preferably not forced/favouritism toward harem path.
Better yet, only 1 girl but her personality, quirks, fetishes and appearance will be customizable by the player at the start of the game and those can remain as they are or change with player's choice as the game progress.