While this might not be something you'd like to read, it is possibly the safest.
Things do get easier as Cal grows through his adventure. You will need to return to some locations as you unlock more abilities and tactics to take on these fine folk. It can be done in lower difficulties, but some you may just need to return later on - when it comes to higher difficulties.