ラマ2：オープンファンデーションと微調整されたチャットモデル
13B 81.7 80.5 50.3 80.7 72.8 77.3 49.4 57.0 67.3 54.8
34B 83.7 81.9 50.9 83.3 76.7 79.4 54.5 58.2 74.3 62.6
70B 85.0 82.850.7 85.3 80.2 80.2 57.460.2 78.5 68.9
表20：標準ベンチマークでのパフォーマンス。
Human-Eval MBPP
pass@1 pass@100 pass@1 pass@80
MPT7B 18.3 - 22.6 30B 25.0 - 32.8 Falcon7B 0.0 - 11.2 40B 0.6 - 29.8 L/l.sc/a.sc/m.sc/a.sc /one.taboldstyle7B 10.5 36.5 17.7 56.2
13B 15.8 52.5 22.0 64.0
33B 21.7 70.7 30.2 73.4
65B 23.7 79.3 37.7 76.8
L/l.sc/a.sc/m.sc/a.sc /two.taboldstyle7B 12.8 45.6 20.8 62.8
13B 18.3 60.2 30.6 69.0
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
13B 81.7 80.5 50.3 80.7 72.8 77.3 49.4 57.0 67.3 54.8
34B 83.7 81.9 50.9 83.3 76.7 79.4 54.5 58.2 74.3 62.6
70B 85.0 82.850.7 85.3 80.2 80.2 57.460.2 78.5 68.9
Table 20: Performance on standard benchmarks.
Human-Eval MBPP
pass@1 pass@100 pass@1 pass@80
MPT7B 18.3 - 22.6 30B 25.0 - 32.8 Falcon7B 0.0 - 11.2 40B 0.6 - 29.8 L/l.sc/a.sc/m.sc/a.sc /one.taboldstyle7B 10.5 36.5 17.7 56.2
13B 15.8 52.5 22.0 64.0
33B 21.7 70.7 30.2 73.4
65B 23.7 79.3 37.7 76.8
L/l.sc/a.sc/m.sc/a.sc /two.taboldstyle7B 12.8 45.6 20.8 62.8
13B 18.3 60.2 30.6 69.0