init_method="file:///{your local file path}",
    rank=rank,
    world_size=world_size
)
model = DistributedDataParallel(local_model, device_ids=[rank])
```
* Design doc
* Documentation
* Acknowledgement (gunandrose4u)
Mobile
PyTorch Mobile supports both iOS and Android with binary packages available in Cocoapods and JCenter respectively. You can learn more about PyTorch Mobile here. 
[Beta] PyTorch Mobile Caching allocator for performance improvements