I'd never make that switch for two reasons:
1. Price of ammo. You can shoot the .22 a couple of hundred times for what a single box of .25 will cost.
2. Reliability. I have two small .22s -- a Taurus PT-22, and my Dad's old Iver Johnson TP-22. Both have been 100% reliable for me.
I've cycled over 2,000 rounds of Winchester Wildcat through my Taurus with 0 failures to fire, 0 failures to feed, and 0 failures to eject.
The only time I ever had an issue with it was light strikes on CCI Blazer .22 (which a friend purchased, I never would as I have always disliked Blazer .22).
I've not fired the IJ nearly as much, but as with the Taurus, it has been absolutely reliable.
As for ammo, you have to really be working at it to get rimlock in a .22 magazine and not notice. I've intentionally tried to do it in the past with both the Taurus and my Buckmark and haven't been able to.
As for rimfire ignition issues, I have had over the years more failures to fire with Remington centerfire ammunition than I have had in tens of thousands of rounds of .22 ammo from PMC, Winchester, Eley, RWS, Federal, and S&W (when they were still making ammo).
I really can't vouch for Remington .22 ammo as I've always stayed away from it from a price point and also from sheer QC issues with their Thunderbolt brand.
Over the years I've frequently carried the Taurus as my only handgun when a larger gun just hasn't been feasible.
And I've never felt to be the least bit compromised from it being a .22.