Reference

The bfloat16 numerical format
https://pytorch.org/docs/master/amp.html#torch.autocast
Intel and Facebook Accelerate PyTorch Performance with 3rd Gen Intel® Xeon® Processors and Intel® Deep Learning Boost’s new BFloat16 capability
