"Best value" had me thinking used Marlin 336 right away. If you want a bigger caliber, they are available in 35 Remington as well as 30-30.
If you definitely want a handgun cartridge, you'll likely have to spend a couple hundred more for a gun as good as the 336. But I know that going the cheaper route sometimes leaves an itch for what you really want, so inexpensive isn't always a good value if you just spend more on something else later on.
I've never shot a Rossi 92, but the short stock and crescent shaped butt plate don't fit me at all. As I was reminded in another recent post, many people put time and/or money into improving the smoothness and function of their Rossi's, which may mitigate any initial savings you'd get over a Henry or Marlin. Of course, I'm sure many people are happy with their Rossis as is.
It sounds like Marlin quality is getting much better again, and the 1894s coming out today are supposed to be far better than some that were hitting shelves 2 or 3 years ago. So if you go that route, either very new or "JM" stamped could be good. I have a JM stamped 1894c (.357) and it's my favorite gun.
Almost everything I hear about Henrys is positive. My own reasons for choosing a Marlin instead had more to do with gun weight than anything else (Henry's 7-pound Big Boy Steel did not exist at the time, only their 9 pound behemoths). I also prefer Marlin's side loading gate over Henry's tube loading design (just personal preference).
Were I in your shoes and knew I wanted a handgun caliber rifle, I'd think more in terms of the features and design you really want rather than cost. A Marlin 1894, a Henry Big Boy, and a tuned-up Rossi will all cost about the same. But do you want a lighter gun or a heavier gun? Do you want to be able to mount a scope easily? Is a manual safety off-putting to you? Does one loading design seem better to you?