I use an 1/8" nail set. It's a strong, heavy punch. The pins are tapered so once they start to move you can push them out the rest of the way with anything.
As tight as those are, you need a starter punch, which is either a short straight, or tapered punch, as mentioned above. Once loose, you can push them out with a regular punch.