Crossed bell on notification meaning in CM12's Lollipop
In Android 5.0 (at least in the CM12 Unofficial builds) you can go to Settings -> Privacy 



From there go in to Filter Notifications. Clicking on an item will allow you to see when it was last blocked and remove it from the list.