

Example: AlexNet from PyTorch to ONNX


Tracing vs Scripting


Avoiding Pitfalls


Limitations


Adding support for operators


Frequently Asked Questions


Contributing / developing


Functions


Classes


torch.onnx diagnostics


Overview


Diagnostic Rules


API Reference


torch.optim


How to use an optimizer


Base class


Algorithms


How to adjust learning rate


Stochastic Weight Averaging


Complex Numbers


Creating Complex Tensors


Transition from the old representation


Accessing real and imag


Angle and abs


Linear Algebra


Serialization


Autograd


DDP Communication Hooks


How to Use a Communication Hook?


What Does a Communication Hook Operate On?


Default Communication Hooks


PowerSGD Communication Hook


Debugging Communication Hooks


Checkpointing of Communication Hooks


Acknowledgements


Pipeline Parallelism


Model Parallelism using multiple GPUs


Pipelined Execution

