I don't know about any stores on the east side of Atlanta, but I will second some of the opinions already offered here. I've bought more from Hot Shots than from anywhere else (good prices and good help). Adventure Outdoors has a good selection, but they are usually higher in price and it is rare that I get decent help there (though I just recently bought a Kimber there at a good price and with some very good service). If you are willing to make the drive up to Jasper, head to the Bargain Barn. I always find that they have the best prices with a good selection and good help. I would buy more there if they were more convenient. Don't bother with Big Ed's in Marietta. As an example, the Kimber I just bought is running from $570 (Bargain Barn)to $610 (Hot Shots) to about$630 at several other stores. Ed's price sticker on the same gun is $800. Now that does include $100 of range time, but that still puts their price well above anyone else's. The Sportsman's Warehouse (Bass Pro Shops) up in Duluth has good prices, but they have a small selection of handguns and the people working there are about as sharp as butter knives.
Hope you find a place that suits your tastes. It is nice to have a good gun shop to go to on a rainy day!
Jack