Let me start by saying, I won't own a gun I won't shoot and use. Now with that said, Nobody loves a beautiful blued gun with a great piece of wood under it more than I do. That's why the majority of my firearms are stainless, or camo'd.
The only blued gun I have is my Franchi O/U Shotgun. Just doesn't seem right for it not to be. But I'm super careful with it when I have it out.
Stainless will take a beating like you won't believe. And if it does show some wear, just buff it out with some fine grit or emory cloth. It'll be good as new.
I've had some pretty thin barrelled rifles made out of stainless and if it won't shoot under an inch at 100 yards, I won't own it. That said, there's only been one that fell in that catagory. The Remington 700BDLSSDM (detachable box magazine). It was a POS. Both the Brownings I've had would do that easily, both were stainless.
Downside to stainless??? Yes, it's addicting!!