Can't load model with specified revision

#9
by Samoed - opened

I'm trying to download model with revision, but it produces error

from sentence_transformers import SentenceTransformer
SentenceTransformer("jxm/cde-small-v2", revision="287bf0ea6ebfecf2339762d0ef28fb846959a8f2", trust_remote_code=True)
ValueError: Unrecognized model in jxm/cde-small-v2. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, ...

I think this is because revision passed to AutoTokenizer somehow, and revisions in repository with tokenizer is different. Same error with v1 version. I think simplest fix would be to upload tokenizer directly to repo, instead of loading from another repo.

Sign up or log in to comment