Preview- move to Trash
You can move those files directly to the Trash. 


Select them in Preview
Drag them above the Trash in the Dock
Wait for ~2 seconds
Finder window will appear and you can drop those files.


However you won't be able to empty the Trash without closing the Preview window first (the file is still in use).