I play on keyboard, I feel like there's too many keybinds and the game requires too much deliberation and precision for controller, not that it couldn't be made to work.
If you're just starting out, do NOT expect to be able to win every fight head on. Lure enemies away one by one with stealth and stone throws, use traps to your advantage, experiment to find the best weapon to use against each opponent, rest and keep your stamina up before fights, try to avoid taking on multiple enemies at once etc. Once you're out of the starting area, hire companions they can be extremely useful.
Check out the wiki as well:
You must be registered to see the links
It's a little incomplete or outdated in some areas, but it contains a ton of super useful info, beginner tips, and advice on how to approach quests and which are worth doing.