How do I actually change the site name on a localized site?
The key to translating the configuration entities and objects is the core module config_translation (Configuration Translation).

This provides extra routes for every form that edits site settings or config entities, which allow editing the translations of translation-enabled config strings.