i18n-Frontpage: inconsistent links to non-default language
What eventually worked for me:

Disable the module "admin_language"

I tried many different configurations of this module but it just kept on giving me English content on the German Frontpage. Views however displayed the correct language.

Should I report this bug to the module maintainers?