As a preview of some of the optimizations discussed in this series, we show the before and after performance scaled in Flops below (Note that these results can vary based on your server resources and model architecture). 



 *T5 3B Performance measured on AWS A100 and A10 servers. Original with no optimizations and Tuned with the applied optimization 



 *T5 11B Performance measured on A100 servers. Original with no optimizations and Tuned with the applied optimization 