If we model the tempo of different sections in this way, why not then model each measure this way?
This would allow for all sorts of variation within a measure without affecting the tempo at the measure-level grid.
The same applies to notes within the beat-level of the grid.