I have never had a problem switching between different style pistols. I have 2 1911s (3&4 inch), a S&W 3rd gen. and a Kahr as my carry pistols. I can see having a problem if I didn't spend ongoing time with each pistol but I do.
Even for competition I can switch back & forth from revolver one week to 1911 to M&P to CZ 75 SA. without a real problem. I do have a handgun in hand dry firing about 5 days a week so I stay very familiar. The one that did give me issues was trying to switch from a Glock to any of the pistols with the 1911 grip angle. I finally realized that even though I could shoot Glocks ok, I did not like the ergonomics. I fixed that by selling the Glocks.
Even for competition I can switch back & forth from revolver one week to 1911 to M&P to CZ 75 SA. without a real problem. I do have a handgun in hand dry firing about 5 days a week so I stay very familiar. The one that did give me issues was trying to switch from a Glock to any of the pistols with the 1911 grip angle. I finally realized that even though I could shoot Glocks ok, I did not like the ergonomics. I fixed that by selling the Glocks.