Holartic,
You made a mistake and I doubt it will happen again. Chalk it up to learning experience. Life is all about awareness, and sadly perception. You need to be aware of your surroundings and also how those in your presence view you. Nothing wrong with carrying, but one needs to be mindful of how others perceive you. In the situation you describe, I can see how those not familiar with CCWs could be alarmed.
Just to be clear, I do not care what others think of me, and I'm not worried about the way I look, I know I'm rough looking (to some people). But when it comes to legal issues, stay below the radar. Better to be left alone than perceived as a threat.
Where I live, allowing your CCW to print can be viewed as brandishing the weapon. Crazy, but not to some LEOs and/or a court of law. You got lucky and nothing bad happened to you or your permit to carry. Lesson learned. If you feel the need to carry all the time, and many do, that's fine, a 442 or SP101 would be a great choice. (I like wheel guns!)
Few years ago, I parked the bike and went into a local watering hole, about 20 mins later a local cop showed up and asked me to step out and talk to him. He asked if I was carrying a gun, told him no. I had a liner lock knife and a leatherman tool. He frisked me and found nothing, asked him what is this all about, a woman had called the police and said a guy on a bike went into the bar room and she saw a gun on his belt. She most likely saw the leatherman holster, its all about perception, it may not be right, but again, be aware of your surroundings and what others may think.
I certainly support open carry, our world would be a better one if more people displayed their ability to protect themselves. However, if you can't OC, hide the gun as best as possible. Letting uninformed people see your CCW only hurts the gun owners cause.
Glad you had no further issues.