Llama 2: オープンファンデーションとファインチューニングされたチャットモデル
Noam Shazeer. Fast transformer decoding: One write-head is all you need, 2019.
Noam Shazeer. Glu variants improve transformer, 2020.
MohammadShoeybi, MostofaPatwary, RaulPuri, PatrickLeGresley, JaredCasper, andBryanCatanzaro.
Megatron-lm: Training multi-billion parameter language models using model parallelism, 2019.
Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Yarin Gal, Nicolas Papernot, and Ross Anderson. The curse
of recursion: Training on generated data makes models forget. arXiv preprint arxiv:2305.17493 , 2023.
Eric Michael Smith and Adina Williams. Hi, my name is martha: Using names to measure and mitigate bias
in generative dialogue models. arXiv preprint arXiv:2109.03300 , 2021.
Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, and Adina Williams. “i’m sorry to
hear that”: Finding new biasesin language models with aholistic descriptor dataset. In Proceedings of the
2022 Conference on Empirical Methods in Natural Language Processing , pages 9180–9211, 2022.
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
Noam Shazeer. Fast transformer decoding: One write-head is all you need, 2019.
Noam Shazeer. Glu variants improve transformer, 2020.
MohammadShoeybi, MostofaPatwary, RaulPuri, PatrickLeGresley, JaredCasper, andBryanCatanzaro.
Megatron-lm: Training multi-billion parameter language models using model parallelism, 2019.
Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Yarin Gal, Nicolas Papernot, and Ross Anderson. The curse
of recursion: Training on generated data makes models forget. arXiv preprint arxiv:2305.17493 , 2023.
Eric Michael Smith and Adina Williams. Hi, my name is martha: Using names to measure and mitigate bias
in generative dialogue models. arXiv preprint arXiv:2109.03300 , 2021.
Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, and Adina Williams. “i’m sorry to
hear that”: Finding new biasesin language models with aholistic descriptor dataset. In Proceedings of the
2022 Conference on Empirical Methods in Natural Language Processing , pages 9180–9211, 2022.