Llama 2: オープンファウンデーションとファインチューンされたチャットモデル
preprint arXiv:2205.01068 , 2022.
Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid
Shojanazeri,MyleOtt,SamShleifer,AlbanDesmaison,CanBalioglu,BernardNguyen,GeetaChauhan,
Yuchen Hao, and Shen Li. Pytorch fsdp: 完全にシャーディングされたデータ並列化のスケーリングに関する経験, 2023.
Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen,
andNanDuan. Agieval: ファウンデーションモデルの評価のためのヒューマンセントリックなベンチマーク. arXivpreprint
arXiv:2304.06364 , 2023.
Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili
Yu,SusanZhang,GargiGhosh,MikeLewis,LukeZettlemoyer,andOmerLevy. Lima: アライメントのために少ない方が良い. arXiv preprint arXiv:2305.11206 , 2023.
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
preprint arXiv:2205.01068 , 2022.
Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid
Shojanazeri,MyleOtt,SamShleifer,AlbanDesmaison,CanBalioglu,BernardNguyen,GeetaChauhan,
Yuchen Hao, and Shen Li. Pytorch fsdp: Experiences on scaling fully sharded data parallel, 2023.
Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen,
andNanDuan. Agieval: Ahuman-centricbenchmarkforevaluatingfoundationmodels. arXivpreprint
arXiv:2304.06364 , 2023.
Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili
Yu,SusanZhang,GargiGhosh,MikeLewis,LukeZettlemoyer,andOmerLevy. Lima: Lessismorefor
alignment. arXiv preprint arXiv:2305.11206 , 2023.