Mac App mysteriously remembers deleted settings
The app is pefectly innocent, this is an issue with preference caching on Mavericks.

What finally worked was running defaults delete $app_id, so in my case:

defaults delete net.conceited.Linkinus


Source: Deleting plist file does not reset app on Mac OS 10.9 Mavericks on StackOverflow