If I had my time again, I would buy a Lee classic four-hole turret press (NOT a progressive) from the start and disable the auto indexing. Then I could set up the dies for all my calibres once and not have to do it again (apart from the bullet seating stem height/crimp if I needed to change projectiles, but that's trivial).
I would recommend that you get a kit. That has all the basics you need to start, apart from the bullets, powder and primers, of course. If you try to get all the individual bits separately, you are bound to forget something. I think most Lee kits come with his reloading manual, which while it's full of his own pet theories and philosophy will not actually steer you wrong in any dangerous way.
Regardless of which manual you get, the opening chapters dealing with the process are essential how-to material, while even if you don't go with that particular manufacturer's bullets, the hints and tips they list under each calibre can be eye openers for the newbie.
I cut my teeth on an RCBS Partner Press kit because I'd played with a Lee basic press in the shop and it was sloppy all over the place, but thinking back I suspect the owner either wasn't keeping an eye on the state of his demo stock or had loosened things up to turn people off Lee. I do not think I would buy the C-frame press - the lowest-level O frame seems a more secure bet - but I have lost any distrust I once had of Lee. Seriously, unless you're doing precision pistol or rifle benchrest or other precision/long (>200yd) range shooting, I'm not sure it matters.