J-Framer:
You are quite correct in your assertion that most criminals (that I have come across, anyway) do not carry multiple weapons, or holsters, or flashlights, tactical or otherwise. They usually carry a weapon only, no reload, etc. so they can ditch the weapon if necessary. Sometimes you get off-body carries, or a girlfriend carrying, or guns secreted in vehicles in natural voids (think detached door trim panels). I even saw one in a steering wheel airbag compartment that had the airbag removed.
LEO's like anybody else, however, go by what they know, their own experiences, and what they hear about. The only time many LEO's carry multiple weapons and associated gear is when they are going out to do something, such as a search warrant or an arrest. They "gear up" or "get dressed" for the business they are going to go do. When they aren't doing warrants and are engaged in normal investigative duties (plainclothes), for example, most LEO's carry A GUN, a single pair of cuffs, and maybe a spare mag. If we encounter some guy, CCW or not, who looks like he is "geared up," the natural reaction is therefore to assume he is geared up for some purpose, such as mayhem of one sort or another. Now, it COULD be that the guy you stop with a bunch of guns and gear is just some paranoid type with hero fantasies about being Bruce Willis in Die Hard or something, and carries all that gear every day, all the time with no nefarious purpose in mind, but what REASONABLE MAN would do that? Every LEO who has carried a gun off duty all the time for a period of years knows what a pain it can be to carry a gun sometimes, and very few LEO's ever run across a situation off duty where they need a gun, so once again, the logical question to ask is: why would any REASONABLE person magnify that weight and discomfort by a factor of three or four unless he was up to something?
There is always the possibility that such a guy is just enthusiastic about his right to carry, but they have a saying that's real popular in law enforcement:
If it looks like a duck, walks like a duck, and talks like a duck, it's probably a duck.
I'm not looking to offend here, and of course it's up to you how you want to do CCW, but if you ever have to deal with the local gendarmes, you don't want to look like a duck.