I have re-barreled three 95s in the past. Two in 338/06 an one in 35 Whelen. It is not really any more difficult than re-barreling a Springfield 1903 or a Mosin/Nagant. And if you copy the barrel contour of the 30-06 you don't harm the future value of the rifle because you need only swap out the barrel for the original. No modification are done to the original parts at all.
On all 3 of the barrels I did I installed scout mounts and scopes, so there was no rear sight to deal with. It would not be hard to install irons if you wanted them however.
But given that you can buy a 270, which shoots flatter than the 6.5 Swede, I personally can't see any advantage to doing the job over just buying the 270.
And as was stated above, there is nothing at all wrong with the grand old 30-06 anyway.
The only reason I can see for a re-barrel job is more power, not less. And in 99% of the cases, you'd never need more power than you can have with the 30-06 anyway.
Custom work is sometimes done because of a need or perceived need, but in most cases, custom work is done for the most important reason of all.
Because we want.