Add insctructions for running model
#4
by
rombodawg
- opened
In order for this model to work (or any deepseek-coder model in the AWQ format) on text generation web ui the "no_inject_fused_attention" parameter must be selected when loading the model using auto-AWQ. please add this to the read me of all the Deepseek-coder model cards for oobagooba infrence.
rombodawg
changed discussion status to
closed
rombodawg
changed discussion status to
open