Install profile with variable default language messes up translations
Turns out to be a simple solution: the variable i18n_string_source_language can be used to specify the source language of all strings, instead of the current site language.

I ended up setting 

$conf['i18n_string_source_language'] = 'en';


in my settings.php. This worked.