To some extent. I stay away from .357 in a snubbie. I've thought about getting a .454 full Ruger Super Redhawk/Blackhawk, but I really don't need that kind of power, nor do I care to deal with the recoil, but I would like it because it's even stronger than the standard Blackhawk.
For semi auto's it depends on the gun. If it's a tiny pocket pistol like the .380's out there, yes, I don't care for .380 pocket pistol because I shoot 20 rds worth in a few minutes and my hand starts shaking like I have Parkinson's.
For larger size semi's, usually doublestacks, I can take the recoil, but that doesn't mean I can shoot blazing fast because of it.