Supported GPU for Pytorch
That's correct, you need a NVIDIA GPU compatible with CUDA 8, 9 or 10: https://pytorch.org/get-started/locally/

NVIDIA has a list of compatible cards here: https://developer.nvidia.com/cuda-gpus#compute

Alternatively you could work on a GPU equipped cloud instance (or install pytorch without GPU).