lm_head missing?

#2
by Alvant - opened

Hello

It seems that there is no lm_head.weight in saved model parameters. Is it OK?) πŸ˜… What is the proper way to load the model? Is it necessary to get this lm_head from somewhere else or something?..

Sorry! my fault. I didn't notice that the architecture is MixtralModel and not MixtralModelForCausalLM. Everything is OK then)

Alvant changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment