Finder: All my Files
The Finders function "All my Files" will show you all files that are saved on your hard drive.

If you delete them they are deleted. How ever, your email could download them again from the email server (like gmail) if you kept them there.