I was about 33 when I got my first deer. I was living in West Texas where long shots are much more common than they would be in wooded, hilly areas. The terrain where you hunt can be a big factor in which gun you choose.
My first deer rifle was a Browning BBR (forerunner of the A Bolts) in 7mm Mag. It was shooter right off the rack although I worked up a load that it liked best. You are right about the BOSS piece being replaceable by one that is quieter for the shooter, although you need to adjust it at the range or lose the accuracy advantage of the BOSS. I put a recoil reducer on that 7 Mag and it nearly put my ears out. That gun now wears a set of earplugs hanging from the sling swivel.
As for the risks of a used gun, I don't know many high volume target shooters who use an '06 (none, in fact). If it were a .308 or one of the 7mm or 6.5s, I'd be more concerned about a shot out barrel. Besides, no target shooter would be using that scope IMO.
The Savage is known as a 'best bang for the buck' gun when it comes to accuracy. Those plastic stocks are almost made to be replaced, though. You can get an inexpensive replacement stock from places like Boyd's or Bell & Carlson. I have a couple Savage 10 FP guns that are tack drivers - not in the same league as a true target rifle but about as good you can get off the rack.
The 30-06 cartridge is a proven round that has taken a lot of deer. The .308 will give you about 95% of the energy without kicking you around so bad. Ammo for the .308 is usually cheaper and more plentiful (maybe not in these times). In the terrain I hunt, the 7 Mag has advantages because of distance and wind. For whitetail, anything from a 270 up will do the job. In brushy areas, you see anything from a 12 ga. slug gun to the old 30-30, even some 44 Mags carbines.
Just this week I dug out a picture of that first deer. What a kid! 1984 in Reagan County, Texas. 12 points and 20 inches. Shot at 415 yards.