All barrels are subject to change in impact due to heat, but some are particularly affected. Barrels lengthen with heat, but don't change diameter much. Change in length can make a bit of a difference, due to harmonics, but internal stress caused by either cold-working, or barrel straightening can cause more wandering.
I never shoot more than 3 shots at a time with a sporter deer hunting rifle and often clean, then cool the barrel and shoot a last shot to verify cold barrel, first-shot condition.
Protectant like Break-Free in the bore can affect POI even more than firing 5 shots fairly quickly in a deer rifle barrel, but it doesn't noticeably affect my .270 Win. Maybe that's because .270 Win rifles are known to be generally quite tolerant of different loads. For instance, in my free-floated barrel, both 90 Grain Sierra HP light target handloads and 130 grain hot handloads POIs hit within a quarter-inch at 100 yards! That may have something to do with the small variation in clean/dirty POI with hunting loads.
For some reason, my 1960's-old Savage 110 30-06 was not tolerant of ammo changes, printing 125 grain loads about 2" from 150s at 100 yds. Neither my .22-250 Rem or Tikka .223 are as load tolerant as my .270. (Your results may vary.)