How do you remove permanent adb authorization?
If your device is rooted, as it probably is with CM, you can also do this via adb:

adb shell rm /data/misc/adb/adb_keys


Depending on your build you probably have to run adb as root(1) or call the su binary(2).

(1) adb root or adb kill-server; sudo $(which adb) start-server --> adb shell rm /data/misc/adb/adb_keys

(2)adb shell --> su --> rm /data/misc/adb/adb_keys

Or delete this file with a root explorer. If you authorized more than one device open this file and remove the public key of the desired device only.