As nemisiss45 said, a true holster belt is going to be much more rigid to support the weight of a loaded firearm, help conceal it if you're wearing an Inside-the-Waistband (IWB) holster, prevent items (pistol, spare magazines, multitool, flashlight if you have one, etc.) from shifting on the belt and generally ensuring that your draw and reload movements are consistent.
Aker makes some nice ones - they used to have a spring steel insert between the 2 layers of leather, and now its polymer (the spring steel was working its way through the belt over time - at least on mine).
There are other good ones out there as well. IMO, though, a good pistol belt and holster is as important for CCW EDC as bullets for the firearm. It's part of a system.
YMMV.