Error loading in text-generation-webui using Transformers
#6
by
vectro
- opened
ValueError: Trying to set a tensor of shape torch.Size([1024, 5120]) in "weight" (which has shape torch.Size([1280, 5120])), this look incorrect.
Never seen this before. Anyone have any ideas? I'm not a programmer, just trying to test chatting with this in the cloud using text-generation-webui (latest)
Figured it out :) I had to install transformers from Source using:
python3 -m pip install --upgrade pip
pip install git+https://github.com/huggingface/transformers.git
Then restarted text-generation-webui and it loaded!
vectro
changed discussion status to
closed