I've had some experience inline with your post. I test dozens of brands in 22 rimfire and keep the targets for future reference. POA/POI varies among the different brands and outstanding hits with one rifle may not be seen in another. In my case I shoot steel chickens every other week. I've selected SK Standard for this season so I bought a couple bricks. I verify the scope at each distance prior to the match. I find the settings are always correct. Once these rounds are depleted, I may choose a different brand. And if so, the scope would need to be zeroed again for best results. Maybe / maybe not. My Kimber seems to shoot quite a lot of brands with superb accuracy. I can say the rifle and scope are much better than I am.
If a buddy wants to go along to try shooting a match, I will loan him a rifle and will give him a box of another popular brand. But before shooting the match, the zero on that scope get's changed for that ammo. And I know what the changes are since I have documented the performance of 3 dozen brands in numerous rifles.
It's easy to see what your case is, if you change boxes, bricks, or lot numbers, the scope might need to change as well.
But be certain of a few things: your hardware is secure, your scope is not moving, and your settings are repeatable. Test your scope by using a bench rest. Adjust so many clicks up, down, left, and right to creat a box pattern. Always aim at the same place. See if you make the box pattern and return to the same spot. Keep in mind it is possible that if you adjust some scopes, you might not have any apparent difference in POA/POI until AFTER the second shot. Some guys give their lower cost scopes a tap after a small change as if to cause the scope to "snap in" place.