I see that you are in Tennessee from your profile location. It's illegal to possess a loaded handgun in public, but a Handgun Carry Permit gives you a defense to that law without specifying open or concealed. So if you don't have a permit, you can do neither. If you have a permit you can do either one, or in between.
If I was making this decision, I might ask myself some questions:
1. Do I care if my friends, family, or coworkers, who I might run into while out shopping or whatever I am doing, see me with a gun on my belt?
2. Do I believe bad guys will leave me alone if they see it, or will they target me.
3. It is a crime to possess a loaded handgun in public, so a police officer would be well within their duty to stop, disarm, question, and possibly even arrest me, if somebody reports me. Do I believe these things will happen, and am I willing to risk these things happening?
4. Am I going somewhere that doesn't have a long-standing policy of allowing lawful handgun carry where other customers might convince the owners to ban guns?
5. Do I want to make a lot of new "friends" from people who see me with a gun and want to start talking about guns while I'm shopping?
6. Do I want to scare strangers? Some might be uncomfortable.
7. Do I want to make strangers feel safe? Some might feel safer with you around.
8. Do I want to participate in desensitizing fellow citizens to the sight of legally-carried handguns?
9. Do I think quick access to my pistol will be of any real advantage?
10. Will my holster secure my handgun well enough to prevent someone from walking up behind me, pulling it out, and running away with it?
These are just some of the things you have to consider when making the decision. Comfort, both physical and emotional, are the issues I would think about first. How would I be comfortable carrying a gun? My answer wouldn't be the same as another person's answer. Other people might have different concerns that I didn't mention above.
In the last few years I've started noticing more people around West Tennessee openly carrying handguns, mostly at Wally World, but at a few other places. More people are getting permits all the time, but I've heard that it is still only about 5-7% of Tennesseans have them. I don't see this state banning open carry, even if some people get scared and complain. I have heard of several businesses posting signs as a result, but I've also heard of several businesses taking down signs after gun-owning customers complained.