Clear popup/push notification of an app without getting it removed from Notification drawer
Unfortunately, in Android 5.0.1 any action done to the notification that isn't opening it will dismiss it. If you can, upgrade to 5.1. In this version, swiping up on the notification will hide it but keep it in the notification panel.