Cool. I don't like the system to be honest, you just described perfectly fine how black and white the whole it is. that is why i have neutral, not even for the scene, but for story perspective, not realy depending on stats but my personal preferences. although, my new main Neutral i just did form base one, a whole new save, is a little bit more on the RP point stats.
but i hope i can maintain the balance, life is not black and white
.
but your idea is definitely not bad. but this black and white , is what lead to the inconsistency of the story.