That's the age-old question, whether your rifle prefers a pressure point or a floated barrel. Some rifles, especially sporter weight barrels shoot better with a pressure point, some don't. The only way to tell for sure is to try it both ways. If your barrel prefers a pressure point it's fairly easy to build one into the stock with a rubber shim or bedding compound.
However, once you sand the ledge out of a barrel, you're never going to get that ledge back. Yes, you can glue in a shim, but that original ledge is gone. If you're getting the accuracy you expect, leave it alone. If you're like the rest of us and are always tinkering iwth a rifle, there are lots of things you can do. Bed the action, bed the chamber, change stocks, add pillars, they're all options. Play with different bullets, powders, primers. Seat them deeper, or seat them longer. Once you start tinkering the options are truly limitless.