RedHatAI
/

Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions Community

alexmarques commited on Oct 10, 2024

Commit

6feca67

·

verified ·

1 Parent(s): 69eb5f4

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -257,7 +257,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>MMLU-Pro
    </td>
    <td>48.1
    </td>
@@ -267,7 +267,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>IFEval
    </td>
    <td>86.4
    </td>
@@ -277,7 +277,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>BBH
    </td>
    <td>55.8
    </td>
@@ -287,7 +287,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>Math |v| 5
    </td>
    <td>26.1
    </td>
@@ -297,7 +297,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>GPQA ()
    </td>
    <td>15.4
    </td>
@@ -307,7 +307,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>MuSR (5-shot)
    </td>
    <td>18.2
    </td>

    </td>
   </tr>
   <tr>
+   <td>MMLU-Pro (5-shot)
    </td>
    <td>48.1
    </td>
    </td>
   </tr>
   <tr>
+   <td>IFEval (0-shot)
    </td>
    <td>86.4
    </td>
    </td>
   </tr>
   <tr>
+   <td>BBH (3-shot)
    </td>
    <td>55.8
    </td>
    </td>
   </tr>
   <tr>
+   <td>Math-|v|-5 (4-shot)
    </td>
    <td>26.1
    </td>
    </td>
   </tr>
   <tr>
+   <td>GPQA (0-shot)
    </td>
    <td>15.4
    </td>
    </td>
   </tr>
   <tr>
+   <td>MuSR (0-shot)
    </td>
    <td>18.2
    </td>