Removing item from download list HTC One S, Android 4.1.1, HTC Sense 4+

I was messing around with a media server at home and started a download of a large file. This file is now gone from the source but the phone is still trying to download it, i.e. it's in the notification list that I drag down from the top of the screen. How do I remove an item from that list?
Killing the Download app (i.e. Force Stop) and then rebooting cleared it.