Llama 2: オープンファンデーションと微調整されたチャットモデル
33B 55.8 46.0 66.7 63.4 57.8
65B 61.8 51.7 72.9 67.4 63.4
L/l.sc/a.sc/m.sc/a.sc /two.taboldstyle7B 42.9 36.4 51.2 52.2 45.3
13B 52.8 44.1 62.6 61.1 54.8
34B 59.4 52.1 71.8 69.2 62.6
70B 65.0 58.0 80.3 74.6 68.9
Table 19: マッシブマルチタスクランゲージアンダースタンディング（MMLU）ベンチマークにおける5ショットパフォーマンス。
BoolQ PIQA SIQA HellaSwag WinoGrande ARC-e ARC-c OBQA CSQA MMLU
MPT7B 75.0 80.6 48.5 76.4 68.3 70.2 42.6 51.4 21.3 26.8
30B 79.0 81.9 48.9 79.9 71.0 76.5 50.6 52.0 58.2 46.9
Falcon7B 67.5 76.7 47.2 74.1 66.3 70.0 42.4 51.6 20.8 26.2
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
33B 55.8 46.0 66.7 63.4 57.8
65B 61.8 51.7 72.9 67.4 63.4
L/l.sc/a.sc/m.sc/a.sc /two.taboldstyle7B 42.9 36.4 51.2 52.2 45.3
13B 52.8 44.1 62.6 61.1 54.8
34B 59.4 52.1 71.8 69.2 62.6
70B 65.0 58.0 80.3 74.6 68.9
Table 19: Five-shot performance on the Massive Multitask Language Understanding (MMLU) benchmark.
BoolQ PIQA SIQA HellaSwag WinoGrande ARC-e ARC-c OBQA CSQA MMLU
MPT7B 75.0 80.6 48.5 76.4 68.3 70.2 42.6 51.4 21.3 26.8
30B 79.0 81.9 48.9 79.9 71.0 76.5 50.6 52.0 58.2 46.9
Falcon7B 67.5 76.7 47.2 74.1 66.3 70.0 42.4 51.6 20.8 26.2