Hugging Face's logo

Intel
/
Mixtral-8x7B-Instruct-v0.1-int4-inc

Model card Files Community
yintongl commited on
Commit
aab4ea2
·
verified ·
1 Parent(s): 8caf5c9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -32,7 +32,7 @@ python3 main.py \
32
  --bits 4 \
33
  --iters 1000 \
34
  --enable_minmax_tuning \
35
- --low_gpu_mem_usage \
36
  --deployment_device 'gpu' \
37
  --scale_dtype 'fp32' \
38
  --eval_bs 32 \
 
32
  --bits 4 \
33
  --iters 1000 \
34
  --enable_minmax_tuning \
35
+ --nsamples 512 \
36
  --deployment_device 'gpu' \
37
  --scale_dtype 'fp32' \
38
  --eval_bs 32 \