---
abstract: 'We consider the problem of aligning continuous word representations, learned in multiple languages, to a common space. It was recently shown that, in the case of two languages, it is possible to learn such a mapping without supervision. This paper extends this line of work to the problem of aligning multiple languages to a common space. A solution is to independently map all languages to a pivot language. Unfortunately, this degrades the quality of indirect word translation. We thus propose a novel formulation that ensures composable mappings, leading to better alignments. We evaluate our method by jointly aligning word vectors in eleven languages, showing consistent improvement with indirect mappings while maintaining competitive performance on direct word translation.'
author:
- |
    Jean Alaux$^{1,2}$ & Edouard Grave$^1$ & Marco Cuturi$^{2,3}$ & Armand Joulin$^1$\
    $^1$Facebook AI Research\
    $^2$CREST ENSAE, Institut Polytechnique de Paris\
    $^3$Google Brain
bibliography:
- 'biblio.bib'
title: Unsupervised Hyperalignment for Multilingual Word Embeddings
---

Conclusion
==========

This paper introduces an unsupervised multilingual alignment method that maps every language into a common space while minimizing the impact on indirect word translation. We show that a simple extension of a bilingual formulation significantly reduces the drop of performance of indirect word translation. Our multilingual approach also matches the performance of previously published bilingual and multilingual approaches on direct translation. However, our current approach scales relatively well with the number of languages, but it is not clear if such a simple approach would be enough to jointly learn the alignment of hundreds of languages.

{'source': 'arXiv_out/1811'}