How to revoke permission given in System Prefs > Security & Privacy > 'Allow'
You can access the list of permissions granted by using terminal.

Type: spctl --list to view all applications.

Finding the app that is causing issues that you want to revoke the permission can be done with:
spctl --remove --label "UnwantedApp"

spctl help can give more context options