Umm, as far a I can remember, the Colt Detective Special is a double-action revolver. There IS no manual safety. If you are really carrying a cocked DA revolver in your pocket, it's a gonadectomy waiting to happen.
If I am wrong about which gun you have, please clarify. If I am right, please decock the revolver and seek instruction on the manual of arms for this weapon.