kikikara commited on
Commit
3ccd44d
ยท
verified ยท
1 Parent(s): 2e14b44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -2
README.md CHANGED
@@ -29,6 +29,21 @@ language:
29
  \n\n### User:\n {question}'''
30
 
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ### How to use
33
 
34
  ```python
@@ -43,7 +58,7 @@ prompt = f"### System:\n๋‹น์‹ ์€ ๋น„๋„๋•์ ์ด๊ฑฐ๋‚˜, ์„ฑ์ ์ด๊ฑฐ๋‚˜, ๋ถˆ๋ฒ•
43
  pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=400, repetition_penalty=1.12)
44
  result = pipe(prompt)
45
 
46
- print(result[0]['generated_text'])
47
 
48
 
49
- ## Evaluation results
 
29
  \n\n### User:\n {question}'''
30
 
31
 
32
+ ### Evaluation results
33
+
34
+ llm as a judge ๋ฐฉ์‹์œผ๋กœ ํ‰๊ฐ€๋ฅธ ์ง„ํ–‰ํ–ˆ์Šต๋‹ˆ๋‹ค.
35
+ ์ž์„ธํ•œ ๋‚ด์šฉ์€ " "๋ฅผ ์ฐธ๊ณ ํ•ด์ฃผ์„ธ์š”
36
+
37
+ | Model | params | Fluency | Coherence | Accuracy | Completeness |
38
+ |---------------------------------------------------------------------------------------------------------|--------|---------|-----------|----------|--------------|
39
+ | **[kikikara/llama_with_eeve_new_03_150m](https://huggingface.co/kikikara/llama_with_eeve_new_03_150m)** | **0.15B** | **63.12%** | **37.18%** | **23.75%** | **23.75%** |
40
+ | [EleutherAI/polyglot-ko-1.3b](https://huggingface.co/EleutherAI/polyglot-ko-1.3b) | 1.3B | 51.25% | 40.31% | 34.68% | 32.5% |
41
+ | [EleutherAI/polyglot-ko-5.8b](https://huggingface.co/EleutherAI/polyglot-ko-5.8b) (this) | 5.8B | 54.37% | 40.62% | 41.25% | 35% |
42
+
43
+ ### kikikara/llama_with_eeve_new_03_150m - 36.953125%
44
+ ### EleutherAI/polyglot-ko-1.3b - 39.6875%
45
+ ### EleutherAI/polyglot-ko-5.8b - 42.8125%
46
+
47
  ### How to use
48
 
49
  ```python
 
58
  pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=400, repetition_penalty=1.12)
59
  result = pipe(prompt)
60
 
61
+ print(result[0]['generated_text'])```
62
 
63
 
64
+ ### How to use