Allow users to access only terms that he created
There is a module that stores authoring information (author, published date and updated date) for the taxonomy term.

This module is views integrated. Exposes authoring information fields (author, published date and updated date) to views configuration (fields/filters/arguments/sorts/relation).

Taxonomy Term Authoring Information

After installing this module, create a view that filters terms and displays only terms created by the current user then change the field widget to use that view.