Update config.json so that it can be run by llm serving engine
#3
by
Pinkgu1
- opened
In github README.md, the user has to update these keys in config.json before running this model.
"attn_logit_softcapping": null,
"final_logit_softcapping": null,
Can we update the config.json to reflect this instead so that the user can just pull from huggingface without needed to patch.
Close as the instruction to set softcapping to null is outdated.
README on Github updated.
RaymondAISG
changed pull request status to
closed