Semantic Evaluation (SemEval-2022), pages 1094–
1106, Seattle, United States. Association for Compu-
tational Linguistics.
Alexis Conneau and Douwe Kiela. 2018. Senteval: An
evaluation toolkit for universal sentence representa-
tions. ArXiv, abs/1803.05449.
Mathias Creutz. 2018. Open subtitles paraphrase corpus
for six languages. In Proceedings of the Eleventh In-
ternational Conference on Language Resources and
Evaluation (LREC 2018), Miyazaki, Japan. European
Language Resources Association (ELRA).
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and
Kristina Toutanova. 2019. Bert: Pre-training of deep
bidirectional transformers for language understand-
ing. In North American Chapter of the Association
for Computational Linguistics.
Ning Ding, Yankai Lin, Zhiyuan Liu, and Maosong
Sun. 2023. Sentence and document representation
learning. In Representation Learning for Natural
Language Processing, pages 81–125. Springer Na-
ture Singapore Singapore.
Aarohi Srivastava et al. 2022. Beyond the imitation
game: Quantifying and extrapolating the capabilities
of language models. ArXiv, abs/2206.04615.
Alexander R Fabbri, Wojciech Kry´sci´nski, Bryan Mc-
Cann, Caiming Xiong, Richard Socher, and Dragomir
Radev. 2021. Summeval: Re-evaluating summariza-
tion evaluation. Transactions of the Association for
Computational Linguistics, 9:391–409.
Manuel Faysse, Patrick Fernandes, Nuno M. Guerreiro,
António Loison, Duarte M. Alves, Caio Corro, Nico-
las Boizard, João Alves, Ricardo Rei, Pedro H. Mar-
tins, Antoni Bigata Casademunt, François Yvon, An-
dré F. T. Martins, Gautier Viaud, Céline Hudelot,
and Pierre Colombo. 2024. Croissantllm: A truly
bilingual french-english language model.
Jack FitzGerald, Christopher Hench, Charith Peris,
Scott Mackie, Kay Rottmann, Ana Sanchez, Aaron
Nash, Liam Urbach, Vishesh Kakarala, Richa Singh,
Swetha Ranganath, Laurie Crist, Misha Britan,
Wouter Leeuwis, Gokhan Tur, and Prem Natara-
jan. 2023. MASSIVE: A 1M-example multilin-
gual natural language understanding dataset with
51 typologically-diverse languages. In Proceedings
of the 61st Annual Meeting of the Association for
Computational Linguistics (Volume 1: Long Papers),
pages 4277–4302, Toronto, Canada. Association for
Computational Linguistics.
Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021.
Simcse: Simple contrastive learning of sentence em-
beddings. In Conference on Empirical Methods in
Natural Language Processing.
Iker García-Ferrero, Rodrigo Agerri, and German Rigau.
2021. Benchmarking meta-embeddings: What works
and what does not. In Findings of the Association
for Computational Linguistics: EMNLP 2021, pages
3957–3972, Punta Cana, Dominican Republic. Asso-
ciation for Computational Linguistics.
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-
Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Kr-
ishnan, Marc’Aurelio Ranzato, Francisco Guzmán,
and Angela Fan. 2021. The flores-101 evaluation
benchmark for low-resource and multilingual ma-
chine translation.
Hang Le, Loïc Vial, Jibril Frej, Vincent Segonne, Max-
imin Coavoux, Benjamin Lecouteux, Alexandre Al-
lauzen, Benoît Crabbé, Laurent Besacier, and Didier
Schwab. 2020. Flaubert: Unsupervised language
model pre-training for french.
Chankyu Lee, Rajarshi Roy, Mengyao Xu, Jonathan
Raiman, Mohammad Shoeybi, Bryan Catanzaro, and
Wei Ping. 2024. Nv-embed: Improved techniques
for training llms as generalist embedding models.
Antoine Lefebvre-Brossard, Stephane Gazaille, and
Michel C. Desmarais. 2023. Alloprof: a new french
question-answer education dataset and its use in an
information retrieval case study.
Haoran Li, Abhinav Arora, Shuohui Chen, Anchit
Gupta, Sonal Gupta, and Yashar Mehdad. 2021.
MTOP: A comprehensive multilingual task-oriented
semantic parsing benchmark. In Proceedings of the
16th Conference of the European Chapter of the Asso-
ciation for Computational Linguistics: Main Volume,
pages 2950–2962, Online. Association for Computa-
tional Linguistics.