How can I get rid of excel files that I can't delete
Force quitting finder "fixes" this but is a work-around. If no one has a better fix, I'm going to have to mark this as the answer.

Press option down while right-clicking the finder in the dock, then click "Relaunch". It relaunched the desktop and the random excel file went away.