Programmatically get exposed filters from view
I think everything is fine. You have to load the taxonomy term names manually like:

\Drupal\taxonomy\Entity\TaxonomyTerm::load($ids)

Or maybe you can do a custom query to load only the taxonomy term titles without any field data (because that is what you need).