taxonomy-term--vocabulary.tpl.php still shows tagged content
As I now think I know what you want, here's what I'd do: use Page Manager to override the default display, then add the rendered Entity display for Taxonomy. That should then pull in your custom template,