OPEA
/

deepseek-vl2-int4-sym-gptq-inc

4-bit precision

Model card Files Files and versions Community

cicdatopea commited on Jan 3

Commit

254e3ef

·

verified ·

1 Parent(s): 648bcc8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -106,7 +106,7 @@ auto-round-mllm \
 --iters 1000 \
 --nsample 512 \
 --seqlen 2048 \
---format 'auto_round' \
 --output_dir "./tmp_autoround"
 ```

 --iters 1000 \
 --nsample 512 \
 --seqlen 2048 \
+--format 'auto_gptq' \
 --output_dir "./tmp_autoround"
 ```