Llama 2: オープンファウンデーションとファインチューンされたチャットモデル
MargaretMitchell,SimoneWu,AndrewZaldivar,ParkerBarnes,LucyVasserman,BenHutchinson,Elena
Spitzer,InioluwaDeborahRaji,andTimnitGebru. Modelcardsformodelreporting. CoRR,abs/1810.03993,
2018. URL http://arxiv.org/abs/1810.03993 .
MosaicML NLP Team et al. mpt-7bの導入：オープンソース、商業利用可能なllmsの新基準、2023年。
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeﬀ Wu, Lonbrown Ouyanbrown, Christina Kim, Christopher
Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen
Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. Webgpt: ブラウザ支援型の質問応答と人間のフィードバック。arXiv, 2021年。
Cuong V. Nguyen, Alessandro Achille, Michael Lam, Tal Hassner, Vijay Mahadevan, and Stefano Soatto.
連続学習における壊滅的忘却の理解に向けて。arXiv preprint arXiv:1908.01091 , 2019年。
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
MargaretMitchell,SimoneWu,AndrewZaldivar,ParkerBarnes,LucyVasserman,BenHutchinson,Elena
Spitzer,InioluwaDeborahRaji,andTimnitGebru. Modelcardsformodelreporting. CoRR,abs/1810.03993,
2018. URL http://arxiv.org/abs/1810.03993 .
MosaicML NLP Team et al. Introducing mpt-7b: A new standard for open-source, commercially usable llms,
2023.
41
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeﬀ Wu, Lonbrown Ouyanbrown, Christina Kim, Christopher
Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen
Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. Webgpt: Browser-assisted
question-answering with human feedback. In arXiv, 2021.
Cuong V. Nguyen, Alessandro Achille, Michael Lam, Tal Hassner, Vijay Mahadevan, and Stefano Soatto.
Toward understanding catastrophic forgetting in continual learning. arXiv preprint arXiv:1908.01091 , 2019.