Error in the running script

#10
by samokosik - opened

Hello,
I tried running the model locally, however, the script you provide does not work.
NameError: name 'MistralForCausalLM' is not defined.
This happens after trying to define the model variable.

Can you please post a script that works?
Thank you

Hi,

The fix is to replace MistralForCausalLM to MixtralForCausalLM. It should be Mixtral not Mistral.

Best

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment