hook_taxonomy_term_update(), where does it get invoked in drupal's core code?
It's invoked from taxonomy_term_save().

The reason you can't find it is because the hook gets invoked via an interpolated string, depending on the current operation (insert or update):

module_invoke_all("taxonomy_term_$op", $term);