Never show the term name if the user has no permission to view the term
You could implement hook_menu_link_alter in a custom module and modify access to /taxonomy/term/xxx, if need be, by overriding the existing access callback with your own.

You will need to look at the menu router table to see exactly what menu item you want to alter.