How can you say that a 180 grain bullet is too heavy for deer?
The most popular deer rifle rifle, a 30-30 Winchester, uses mainly a 170 grain bullet at about 2200 fps. Much, much faster and more powerful than a 357!
I think 180 grain is ideal for deer, and even then at close range!!