Its an attachment point for a shoulder stock. The picture also shows the fourth frame screw which together with a small machined cut on the bottom of the backstrap is used to attach a shoulder stock to the m1860. Not all m1860´s have these features.
The shoulder stocks are reproduced if you want one for your gun.