Taxonomy terms follow/unfollow module (even for anonymous users)
You can use my sandbox module
Total Subscription

This module is in the Drupal project applications' issue queue.

It will provide the functionality as per your requirement.