Sometimes the problem is with the size of the nipple and sometimes it's the brand of the cap.
Perhaps your nipple is undersized and a new replacement would fit better.
Or try a different brand or size of cap.
Smokin'Joe recently described a unique way to resize loose caps to fit better on nipple cones that are too small.
See post #22: