WestlakeNLP
/

WhizReviewer-ML-Llama3.1-8B

Text Generation

text-generation-inference

Model card Files Files and versions Community

MinjunZhu commited on Aug 16, 2024

Commit

8b1bfe5

·

verified ·

1 Parent(s): 8cbbbd1

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -112,8 +112,8 @@ To generate Review comments, we need a long context (**14000 tokens for Input an
 |          Model Name          | Recommended Config (bs>=5) |          Minimum Config (bs=1)          |
 | :--------------------------: | :------------------------: | :-------------------------------------: |
 | WhizReviewer-ML-Llama3.1-8B  |    2 x A100/H100 (bf16)    | 1 x A100/H100 (int8) / 1 x A6000 (int4) |
-| WhizReviewer-ML-Llama3.1-70B |    8 x A100/H100 (bf16)    |          4 x A100/H100 (bf16)           |
-|   WhizReviewer-ML-Pro-123B   |    8 x A100/H100 (bf16)    |          4 x A100/H100 (bf16)           |
 ##### Getting Your Paper Text

 |          Model Name          | Recommended Config (bs>=5) |          Minimum Config (bs=1)          |
 | :--------------------------: | :------------------------: | :-------------------------------------: |
 | WhizReviewer-ML-Llama3.1-8B  |    2 x A100/H100 (bf16)    | 1 x A100/H100 (int8) / 1 x A6000 (int4) |
+| WhizReviewer-ML-Llama3.1-70B |    8 x A100/H100 (bf16)    |          2 x A100/H100 (bf16) / 1 x A100/H100 (int4)           |
+|   WhizReviewer-ML-Pro-123B   |    8 x A100/H100 (bf16)    |          2 x A100/H100 (bf16) / 1 x A100/H100 (int4)            |
 ##### Getting Your Paper Text