Update README.md
Browse files
README.md
CHANGED
@@ -29,6 +29,21 @@ language:
|
|
29 |
\n\n### User:\n {question}'''
|
30 |
|
31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
32 |
### How to use
|
33 |
|
34 |
```python
|
@@ -43,7 +58,7 @@ prompt = f"### System:\n๋น์ ์ ๋น๋๋์ ์ด๊ฑฐ๋, ์ฑ์ ์ด๊ฑฐ๋, ๋ถ๋ฒ
|
|
43 |
pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=400, repetition_penalty=1.12)
|
44 |
result = pipe(prompt)
|
45 |
|
46 |
-
print(result[0]['generated_text'])
|
47 |
|
48 |
|
49 |
-
|
|
|
29 |
\n\n### User:\n {question}'''
|
30 |
|
31 |
|
32 |
+
### Evaluation results
|
33 |
+
|
34 |
+
llm as a judge ๋ฐฉ์์ผ๋ก ํ๊ฐ๋ฅธ ์งํํ์ต๋๋ค.
|
35 |
+
์์ธํ ๋ด์ฉ์ " "๋ฅผ ์ฐธ๊ณ ํด์ฃผ์ธ์
|
36 |
+
|
37 |
+
| Model | params | Fluency | Coherence | Accuracy | Completeness |
|
38 |
+
|---------------------------------------------------------------------------------------------------------|--------|---------|-----------|----------|--------------|
|
39 |
+
| **[kikikara/llama_with_eeve_new_03_150m](https://huggingface.co/kikikara/llama_with_eeve_new_03_150m)** | **0.15B** | **63.12%** | **37.18%** | **23.75%** | **23.75%** |
|
40 |
+
| [EleutherAI/polyglot-ko-1.3b](https://huggingface.co/EleutherAI/polyglot-ko-1.3b) | 1.3B | 51.25% | 40.31% | 34.68% | 32.5% |
|
41 |
+
| [EleutherAI/polyglot-ko-5.8b](https://huggingface.co/EleutherAI/polyglot-ko-5.8b) (this) | 5.8B | 54.37% | 40.62% | 41.25% | 35% |
|
42 |
+
|
43 |
+
### kikikara/llama_with_eeve_new_03_150m - 36.953125%
|
44 |
+
### EleutherAI/polyglot-ko-1.3b - 39.6875%
|
45 |
+
### EleutherAI/polyglot-ko-5.8b - 42.8125%
|
46 |
+
|
47 |
### How to use
|
48 |
|
49 |
```python
|
|
|
58 |
pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=400, repetition_penalty=1.12)
|
59 |
result = pipe(prompt)
|
60 |
|
61 |
+
print(result[0]['generated_text'])```
|
62 |
|
63 |
|
64 |
+
### How to use
|