Remove an app from Notification Center preference pane
Open Safari › Preferences › Notifications
There you can remove objects permanently by selecting the notification you wish to delete and then either hitting the delete key or by using the remove button ('-') if it exists.