Well if you want cheap, I would recommend a Marlin 795 any day of the week. I'm pretty sure they're still doing it, but its $125 with a $25 mail-in rebate. How can you go wrong? There's also the Mossberg 702 Plinkster, Marlin 60...
As for the bolt-action route, you could go Savage Mark II f (that's the basic version) for mid 100's... I think Mossberg makes a cheap bolt action, which I think is only a bolt version of the 702 Plinkster I mentioned a second ago. There's also the Marlin XT-22, but then your in the low $200 range. At that point, it's not really "cheap" anymore, but you did say "fairly" low priced... Anyway, that's about it for rifle's I know off the top of my head.
As for a scope, any old 4x32 scope will do. I actually have a Tasco Red Dot on my 795, which I got cheap, about 25 bucks on sale. Tasco also has a 3-9x32, which I plan to put on the XT-22 when I get it. As a matter of fact, I was in the shop yesterday and should have bought the XT-22, but seeing as how I went in for a Mosin Nagant 91/30, which they didn't have, I might have been a little disgruntled. Better snag that next time I'm there