neuralmagic
/

Mixtral-8x7B-Instruct-v0.1-FP8

Mixture of Experts

compressed-tensors

Model card Files Files and versions Community

nm-research commited on 19 days ago

Commit

9a978d5

·

verified ·

1 Parent(s): cdc4455

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ tags:
 - **Model Developers:** Neural Magic
 Quantized version of [Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1).
-It achieves an average score of <TODO> on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) benchmark (version 1), whereas the unquantized model achieves 73.44.
 ### Model Optimizations

 - **Model Developers:** Neural Magic
 Quantized version of [Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1).
+It achieves an average score of 72.66 on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) benchmark (version 1), whereas the unquantized model achieves 73.44.
 ### Model Optimizations