How to Run Pytorch Bert with AMD
github code: https://github.com/bellowman/Deep-Learning-Practice/blob/main/BioBert%20for%20Multi%20Label%20AMD.ipynb
Hello everyone,
I am a beginner with pytorch, tensorflow, and BERT. I have a machine at home with an AMD Ryzen 7 1800x and a Radeon RX 6600 video card.
I am trying to run a bioBERT model at home. I have trouble leveraging my model to use my AMD card. I posted my github notebook. I have troubles in cell 3 and 9.

First Question: In cell 3,I am trying to convert the bioBERT weight to PyTorch with transformmer-cli. I get the warning of &quot;Could not load dynamic library 'cudart64_110.dll'&quot;. Does this affect performance later?
Second Question: In cell 9, My model load is really slow because it is using just the CPU. How can I get the model to run on my AMD GPU


Thank you to chrispresso
AMD ROCm seems to be the way to go, but it requires one to run under linux
