How to revoke "Always allow" privileges from an application?
Launch the Keychain Access Utility and find the entry you used that password:

Right click it to bring up its info window
Click the Access Control Tab and there you will see a list of applications that have &quot;Always allow access&quot; enabled
Highlight the application in the list that you want remove and click the [-] button to remove it from Always allowed access.