docker pull ghcr.io/pytorch/pytorch-nightly
And for ad hoc experiments just make sure that your container has
access to all your GPUs:
docker run --gpus all -it ghcr.io/pytorch/pytorch-nightly:latest /bin/bash