Admin Menu Permissions
The taxonomy fact was just an example. I also need this for webforms, so it would be better to have a general solution for that then just for a single module since this problem will occure for every configuration that is stored below "Structure".

It got this fixed using: Admin Links Access Filter