Training a model on GPU is very slow
I am using A100-SXM4-40GB Gpu but training is terribly slow. I tried two models, a simple classification on cifar and a Unet on Cityscapes. I tried my code on other GPUs and it worked totally fine, but I do not know why training on this high capacity GPU is super slow.
I would appreciate any help.
Here are some other properties of GPUs.
GPU 0: A100-SXM4-40GB
GPU 1: A100-SXM4-40GB
GPU 2: A100-SXM4-40GB
GPU 3: A100-SXM4-40GB


Nvidia driver version: 460.32.03
cuDNN version: Could not collect


Thank you for your answer. Before trying your answer, I decided to uninstall anaconda and reinstall it and this solved the problem.
