How does a Pytorch neural network load dataset into GPU
When loading a dataset into the GPU for training, would a Pytorch NN load the entire dataset or just the batch?
I have a 33GB dataset that fits comfortably on my normal RAM (64GB) but i only have a 16GB of GPU RAM (T4). As long as Pytorch only loads one batch at a time into the GPU, that should work fine without any memory problems?

You can load one batch of data at a time into GPU. You should use data loader to fetch a batch of data and also initialize a torch device instance to use GPU.
You can check the following tutorial. It uses data loader to get data as batches and load them to GPU by using torch device.
https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html
