Solr search api indexing referenced fields by their id not value
Just to provide an answer, maybe it'll be useful to someone.
You can't At least not without a lot of hacking/patching the solr api module.