This "the male character is a happy moron" trope has to end. (I assume) the intended goal of lovable comic relief.
Personally, it's one of my favorite things about OoT. CJ becomes a brain-dead harem protagonist as a coping mechanism from his past trauma. As someone who hates the harem genre, that strikes a
perfect note. Aside from that, CJ's character and the way it's constructed has a lot of interesting play when contrasted with the various characters and their dilemmas. There's weight when he acts with forbearance, there's the charm of him cutting to the heart of matters in simple and affecting ways, and there's an intelligent contrast with his younger, more sensitive self.
This game does a lot of interesting, thoughtful things with the trope of idiotic harem protagonist in my opinion and it sounds like you didn't get very far into it to see them. Which is fair, not every game can resonate with any given person, but I would probably not go announcing my decision to drop a game as if it's some sort of revelation.