Error FineTune with GPU 40GB !!!!!!!!!

#34

by developeranalyser - opened Apr 17, 2024

Apr 17, 2024

i have 40GB gpu vram and id get error CUDA out of memory.
with A100 gpu

for fine tune how much gpu vram needed ?
id use colab pro its possible ?

Isn't it ridiculous?

TnkU

Apr 22, 2024

how can reduce qpu usage ?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment