Get all entities tagged with term
I'm afraid not. The taxonomy index table is maintained specifically for nodes. There is no equivalent for other entities. It would be possible to maintain an index of your own though.

A workaround would be reusing the same field on different fieldable entities. Then you would only need to query the data field table to get all referenced entities.