Hugging Face's logo

noneUsername
/
Mistral-Nemo-Instruct-2407-W8A8-Dynamic-Per-Token-better

Safetensors
mistral
8-bit precision
Model card Files Community
1
noneUsername commited on
Commit
89aff9a
·
verified ·
1 Parent(s): bb478f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -1,3 +1,7 @@
 
 
 
 
1
  vllm (pretrained=/root/autodl-tmp/Mistral-Nemo-Instruct-2407,add_bos_token=true,tensor_parallel_size=2,max_model_len=4096,gpu_memory_utilization=0.85,swap_space=0), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
2
  |Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
3
  |-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
 
1
+ ---
2
+ base_model:
3
+ - unsloth/Mistral-Nemo-Instruct-2407
4
+ ---
5
  vllm (pretrained=/root/autodl-tmp/Mistral-Nemo-Instruct-2407,add_bos_token=true,tensor_parallel_size=2,max_model_len=4096,gpu_memory_utilization=0.85,swap_space=0), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
6
  |Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
7
  |-----|------:|----------------|-----:|-----------|---|----:|---|-----:|