FINALLY !!!! Finally got the rear sight base off, the front pin was tough but I got it out, now the rear one was pure HELL, I broke several punches, had to drill it out a bit to use the remaining bigger punches.
I even managed to get a black eye, yes a black eye, didn't wear goggles when a piece of a punch flew out and hit me right under the eye.
The retaining screw, well that one I just drilled out and punched through.
Now I can finally focus on the rest of the project. Went to Ace hardware and bought some brass tubing to use as bed pillars, also got some thin strips of brass to use as shims. So now I'll do the pillars and shims first, before I finish with bedding the action.