
New prototype features and technologies across TensorParallel, DTensor, 2D parallel, TorchDynamo, AOTAutograd, PrimTorch and TorchInductor.





Stable

Beta

Prototype

Performance Improvements





Accelerated PT 2 Transformers


torch.compile


DTensor


CUDA support for 11.7 & 11.8 (deprecating CUDA 11.6) 






PyTorch MPS Backend


TensorParallel

