How to limit the volume of sound effects in Finder?
In System Preferences > Sound > Sound Effects ... set Alert volume to the level you want.

This will also control the volume of the event sounds played in Finder.

You can also uncheck [] Play user interface sound effects to not have them play at all.