


Python 3.8 (deprecating Python 3.7)







Scaled dot product attention


2D Parallel


AWS Graviton3






functorch


Torch.compile (dynamic=True)







Dispatchable Collectives







Torch.set_default & torch.device









