The first one that pops in my head is the Rossi 92. Some have been hit or miss in reliablity from what I've heard/read. I do have a Henry that is more expensive but I would recommend it every day unless you come across a JM Marlin. Then the Marlin wins. Brand new off the shelf, I recommend the Henry.
Has to be the Rossi. Winchester, browning, Henry, uberti, marlin are all at least double the Rossi. Unless there is a manufacturer I'm forgetting or don't know about. Rossi is excellent quality for the price too.
What ever the choice of gun, the least expensive center fire caliber ammo would have to be the .38 Special at $12 to $15 per box.
Factory reloads are even better at around $10 to $12 per box.
38/357 for sure. Fmj flat nose feed best. Freedom munitions sells reloaded 38 for $12 per 50 and new starline brass 357 for $17 per 50. I've shot thousands of the 38 and some of the 357 with no issues. Seems like that would be the cheapest option.