Secure Empty Trash can't count?
Secure emptying takes long because instead of marking the areas of your disk which stored the files you're deleting as "available", it overwrites them with junk in order to make difficult recovering those data.

What you say happens to me too, I think it's pretty normal. i.e. it could be deleting .DS_Stores when you delete a directory.