Llama 2: オープンファウンデーションとファインチューンされたチャットモデル
scialom20a.html。
Thomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, Benjamin Piwowarski, and Jacopo Staiano. Coldgans: 慎重なサンプリング戦略で言語GANSを手なずける. Advances in Neural Information Processing Systems, 33:18978–18989, 2020b.
Rico Sennrich, Barry Haddow, and Alexandra Birch. サブワードユニットを用いたレアワードのニューラル機械翻訳, 2016.
Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, and Omer Levy. SCROLLS: 長い言語シーケンスに対する標準化された比較. In Proceedingsofthe2022ConferenceonEmpiricalMethodsinNaturalLanguageProcessing, pages12007–12021, Abu Dhabi, United Arab Emirates, December 2022. Association for Computational Linguistics. URL https://aclanthology.org/2022.emnlp-main.823.
Noam Shazeer. 速いトランスフォーマーデコーディング: 1つの書き込みヘッドがすべて必要です, 2019.
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
scialom20a.html .
ThomasScialom,Paul-AlexisDray,SylvainLamprier,BenjaminPiwowarski,andJacopoStaiano. Coldgans:
Taming language gans with cautious sampling strategies. Advances in Neural Information Processing Systems ,
33:18978–18989, 2020b.
RicoSennrich,BarryHaddow,andAlexandraBirch. Neuralmachinetranslationofrarewordswithsubword
units, 2016.
UriShaham,EladSegal,MaorIvgi,AviaEfrat,OriYoran,AdiHaviv,AnkitGupta,WenhanXiong,MorGeva,
Jonathan Berant, and Omer Levy. SCROLLS: Standardized CompaRison over long language sequences. In
Proceedingsofthe2022ConferenceonEmpiricalMethodsinNaturalLanguageProcessing ,pages12007–12021,
Abu Dhabi, United Arab Emirates, December 2022. Association for Computational Linguistics. URL
https://aclanthology.org/2022.emnlp-main.823 .
Noam Shazeer. Fast transformer decoding: One write-head is all you need, 2019.