I think Fast Learner is self limiting. It's not worth the investment until you've spent 3,000 points on skills, so as long as you're conservative with XP awards, there shouldn't be a problem.
As far as attributes, it depends. For battle armor, I think it's worth buying up to seven for the bonus since the minimum is so high. For most purposes though, four is the way to go.