I have what I think are average size hands and no problems with "thumb rub". I grip the gun tightly with the thumb down and out of the way of the thumb piece.
FWIW, I don't like the "modern" rubber grips as I don't feel they give me enough control, so I replace them with the old style wood grips, of which I have a goodly supply thanks to those who wanted the rubber kind.
Jim