Well, since my AR is set up for service rifle match shooting it has iron sights, I just automatically assume the same of others until told otherwise. Yes, the scope seems like the obvious suggestion, now that someone else thought of it. You've probably got something in the system (scope or base) that has two fairly stable positions that it tends toward. All the way left or all the way right. Recoil is apparently knocking it from one extreme to the other. The exact recoil profile for the powder and bullet used may tend to cause it more.
If you are at the range again with this load, after each shot, bang on the left side of the receiver with your palm, and push the scope and base left before each shot and see if the group doesn't tend to stay put. Then try it on the other side to see if it moves over.
If you are at the range again with this load, after each shot, bang on the left side of the receiver with your palm, and push the scope and base left before each shot and see if the group doesn't tend to stay put. Then try it on the other side to see if it moves over.