
We profiled the optimal number of micro-batches  for different pipeline lengths . Results are summarized in Figure 11. As we can see, different  values lead to different optimal , and the throughput gaps across different M values are large (as shown when ), which confirms the necessity of an anterior profiler in elastic pipelining.
Understanding the Timing of Caching



Figure 12. the timing of caching
