How to delete audio input option in system preferences macOS
I've found a solution:
Go to System preferences → Accessibility → Voice Control.
There you can choose the desired audio input. Setting it for voice control sets it for dictation as well.
You do not have to turn on voice control.