One-by-one file deletion for a derived list of files
I may suggest the following : why checking for file deletion ?

if (File.Exists(fileEntry))


After all, in file.delete documentation we have :


  If the file to be deleted does not exist, no exception is thrown.