How do I override the vocabulary template but only on a specific content type
I think you can make that with views :)

You have to create your views with the fields  you need. After that you will be able to theme them globally and locally.
check views's theme suggestion 

i hope it helped you