If the barrel length and ammunition are the same then the larger, heavier framed gun will move less movement under recoil since more energy is spent moving the greater mass. For example - let's say 100lbs of force moves an object weighing 10lbs 5 feet in 1 second, that same amount of force will move a lighter object further and a heavier object shorter distances in the same amount of time. So, a 3" large frame revolver weighing 45oz will move less under recoil than a 3" small frame revolver weighing 15oz when shooting the same load. Frame geometry and grip shape and material will make a difference in how the recoil feels to the shooter - rubber grips will absorb some of the impact where wood will not, etc. - but that doesn't change the physics of force vs mass.
Beyond that it is what you, the shooter, are comfortable with. I don't mind shooting my 327NG with full house magnum loads, I don't enjoy it, but I don't mind it. Put that same ammo in a 6" steel M27 and I'll shoot it all day and have a good time doing it.