Building a search View that respects access control
For the Search Views module there's an option that enables further access checks on indexed entities that will enable your Taxonomy Access Control permission check. 

You'll find in the Views UI under Advanced > Query settings on via the Settings link. It is enabled via the Additional access checks on result entities checkbox. As a caveat, this option will make result counts, pagination, and other search result details behave oddly since  permission checks can't be made at index time.