Pressing Siri button disables fans
This is an intended feature of macOS and has been noted since as early as 2016 for Siri and dictation.

Even with third-party utilities like Temp Monitor that control fan speed, Siri and dictation will slow down fan speeds to an acceptable level while in use.