How to control how long Google Assistant keeps listening when there is silence?
From Google help


  There isn't any way at this time to force the microphone to stay on for Voice Typing. When you pause for several seconds, voice typing assumes you're taking a break. This likely helps to conserve your device's battery as well


I haven't found any workaround on XDA .

So, I guess sending Google feedback is the only way out for now