All of my Finder sounds refuse to play
After further investigation, I discovered that the issue was not confined to Finder sounds but other sounds as well.

I deleted the com.apple.SystemSounds preference file from ~/Library/Preferences, restarted my computer and it solved the issue.