
Distributed Training: Gloo is now supported for distributed training jobs.
Correlate Operators in the Forward & Backward Pass: This helps map the operators found in the forward pass to the backward pass, and vice versa, in a trace view.
TensorCore: This tool shows the Tensor Core (TC) usage and provides recommendations for data scientists and framework developers.
NVTX: Support for NVTX markers was ported from the legacy autograd profiler.
Support for profiling on mobile devices: The PyTorch profiler now has better integration with TorchScript and mobile backends, enabling trace collection for mobile workloads.

Refer to this documentation for details. Check out this tutorial to learn how to get started with this feature. 
PyTorch Mobile
(Beta) Android NNAPI Support in Beta