You can pull out the right side arm of the ambi safety and the gun should still work fine, but you will have an annoying little hole there. If you put in a single side safety, you will still have that hole.
This came up with the Kimber Heritage where if you used to coupon to buy the new dot sight, the mounts for the sight made it necessary to remove the right side thumb safety, leaving a little hole.
Just curious, why would you remove the ambi safety? Is it causing you problems or do you just not like it? Personally, I like them because it allows me right right handed or left handed gun use. It is a lot harder to switch hands and operate the thumb safety if you have it on one side only.
Maybe you could get a machinist to make you a little plug for the hole out of aluminum to match the frame?