I haven't heard of anyone having trouble with this type of problem, and with many people shooting them in competition, I'd expect to hear about it if it really is a problem. If you're concerned about it, call up CZ-USA and order some more plastic followers. If something is going to wear out, what do you want it to be, a cheap and easy to replace follower, or part of the slide? I'd really stay away from getting a metal follower, especially if this is a significant wear point.
Now that you mention it, I might just order a couple myself. And maybe another plastic guide rod too. Who knows what the future might bring?