Three inches is manageable. What loads have you experimented with? The difference between light and heavy 200's and 240's greatly exceeded the sight adjustment on my Virginian Dragoon. Understanding the effect of rotaion was a real education(ie: faster can hit lower)
Hot and heavy may be a bear issue, but if backing down a little makes your sight picture work bambi won't care. Have you experimented with your grip? A little higher can reduce the effect of rotation also.