CarrotAI commited on
Commit
bb3c048
·
verified ·
1 Parent(s): 37ae874

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.2
3
+ datasets:
4
+ - CarrotAI/Magpie-Ko-Pro-AIR
5
+ - CarrotAI/Carrot
6
+ - CarrotAI/ko-instruction-dataset
7
+ language:
8
+ - ko
9
+ - en
10
+ base_model:
11
+ - meta-llama/Llama-3.2-3B-Instruct
12
+ pipeline_tag: text-generation
13
+ ---
14
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/vi2T43yS-HZhsqhnHTvX7.png)
15
+
16
+
17
+ ## Score
18
+
19
+ |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
20
+ |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
21
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.6179|± |0.0134|
22
+ | | |strict-match | 5|exact_match|↑ |0.6171|± |0.0134|
23
+
24
+
25
+ | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
26
+ |----------------|------:|------|-----:|--------|---|-----:|---|------|
27
+ |kobest_boolq | 1|none | 5|acc |↑ |0.7664|± |0.0113|
28
+ | | |none | 5|f1 |↑ |0.7662|± | N/A|
29
+ |kobest_copa | 1|none | 5|acc |↑ |0.5620|± |0.0157|
30
+ | | |none | 5|f1 |↑ |0.5612|± | N/A|
31
+ |kobest_hellaswag| 1|none | 5|acc |↑ |0.3840|± |0.0218|
32
+ | | |none | 5|acc_norm|↑ |0.4900|± |0.0224|
33
+ | | |none | 5|f1 |↑ |0.3807|± | N/A|
34
+ |kobest_sentineg | 1|none | 5|acc |↑ |0.5869|± |0.0247|
35
+ | | |none | 5|f1 |↑ |0.5545|± | N/A|
36
+ |kobest_wic | 1|none | 5|acc |↑ |0.4952|± |0.0141|
37
+ | | |none | 5|f1 |↑ |0.4000|± | N/A|
38
+
39
+ ```
40
+ @article{Llama3.2RabbitKo3BInstruct,
41
+ title={CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct Card},
42
+ author={CarrotAI (L, GEUN)},
43
+ year={2024},
44
+ url = {https://huggingface.co/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct}
45
+ }
46
+ ```