WestlakeNLP
/

WhizReviewer-ML-Llama3.1-70B

Text Generation

text-generation-inference

Model card Files Files and versions Community

MinjunZhu commited on Aug 16, 2024

Commit

a3bf264

·

verified ·

1 Parent(s): b7c7de2

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -113,8 +113,8 @@ To generate Review comments, we need a long context (**14000 tokens for Input an
 |          Model Name          | Recommended Config (bs>=5) |          Minimum Config (bs=1)          |
 | :--------------------------: | :------------------------: | :-------------------------------------: |
 | WhizReviewer-ML-Llama3.1-8B  |    2 x A100/H100 (bf16)    | 1 x A100/H100 (int8) / 1 x A6000 (int4) |
-| WhizReviewer-ML-Llama3.1-70B |    8 x A100/H100 (bf16)    |          4 x A100/H100 (bf16)           |
-|   WhizReviewer-ML-Pro-123B   |    8 x A100/H100 (bf16)    |          4 x A100/H100 (bf16)           |
 ##### Getting Your Paper Text

 |          Model Name          | Recommended Config (bs>=5) |          Minimum Config (bs=1)          |
 | :--------------------------: | :------------------------: | :-------------------------------------: |
 | WhizReviewer-ML-Llama3.1-8B  |    2 x A100/H100 (bf16)    | 1 x A100/H100 (int8) / 1 x A6000 (int4) |
+| WhizReviewer-ML-Llama3.1-70B |    8 x A100/H100 (bf16)    |          2 x A100/H100 (bf16) / 1 x A100/H100 (int4)           |
+|   WhizReviewer-ML-Pro-123B   |    8 x A100/H100 (bf16)    |          2 x A100/H100 (bf16) / 1 x A100/H100 (int4)            |
 ##### Getting Your Paper Text