^^^ This.
I usually use a DULL putty knife/scraper, being careful not to scratch them. The varnish (or whatever finish they used) usually isn't bonded well to the metal and can be flaked off. You could use a chemical remover on a q-tip I suppose, but you risk getting it on the stock.