EleutherAI
/

polyglot-ko-1.3b

Text Generation

text-generation-inference

Model card Files Files and versions Community

hyunwoongko commited on Sep 15, 2022

Commit

6a727c1

·

1 Parent(s): 5355201

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -92,8 +92,8 @@ The following tables show the evaluation results with the various number of few-
 | Model                                                                                        | parameters | boolq      | copa       | wic        | hellaswag  | sentineg   | average    |
 |----------------------------------------------------------------------------------------------|------------|------------|------------|------------|------------|------------|------------|
 | [skt/ko-gpt-trinity-1.2B-v0.5](https://huggingface.co/skt/ko-gpt-trinity-1.2B-v0.5) &dagger; | 1.2B       | **0.6663** | 0.6222     | 0.656      | 0.4011     | 0.3534     | 0.5398     |
-| [kakaobrain/kogpt](https://huggingface.co/kakaobrain/kogpt) &ast;                            | 6.0B       | 0.3241     | 0.719      | 0.1356     | **0.4616** | 0.8056     | 0.48936    |
-| [EleutherAI/gpt-neox-ko-1.3b](https://huggingface.co/EleutherAI/gpt-neox-ko-1.3b) (ours)     | 1.3B       | 0.5174     | 0.**7072** | **0.6567** | 0.417      | **0.8444** | **0.5468** |
 - the number of few shot examples = 50

 | Model                                                                                        | parameters | boolq      | copa       | wic        | hellaswag  | sentineg   | average    |
 |----------------------------------------------------------------------------------------------|------------|------------|------------|------------|------------|------------|------------|
 | [skt/ko-gpt-trinity-1.2B-v0.5](https://huggingface.co/skt/ko-gpt-trinity-1.2B-v0.5) &dagger; | 1.2B       | **0.6663** | 0.6222     | 0.656      | 0.4011     | 0.3534     | 0.5398     |
+| [kakaobrain/kogpt](https://huggingface.co/kakaobrain/kogpt) &ast;                            | 6.0B       | 0.3241     | **0.719**  | 0.1356     | **0.4616** | 0.8056     | 0.48936    |
+| [EleutherAI/gpt-neox-ko-1.3b](https://huggingface.co/EleutherAI/gpt-neox-ko-1.3b) (ours)     | 1.3B       | 0.5174     | 0.7072     | **0.6567** | 0.417      | **0.8444** | **0.5468** |
 - the number of few shot examples = 50