CamemBERT (Martin et al., 2019),FlauBERT
(Le et al., 2020) and even the very recent
CroissantLLM (Faysse et al., 2024).
• Variety: Diverse model types were included
to offer an insightful analysis across vari-
ous model characteristics (dimension, training
strategy, etc.).
In line with the third objective, we explicit below
the studied characteristics of embedding models
that will be discussed with the results.
• Embedding dimension:This critical element
influences the expressiveness of the represen-
4