5. A computer-implemented method comprising: determining that received audio data corresponding to at least one utterance includes first audio data, wherein the first audio data corresponds to a first source direction; performing automatic speech recognition processing on the first audio data to determine a first hypothesis including one or more of at least one first word or a representation of at least one first word potentially corresponding to the first audio data; determining that a first portion of the first audio data corresponds to speech; determining a first value representing a first time duration of the first portion of the first audio data; determining a first duration weight factor based at least in part on the first value; determining, in the first hypothesis, a representation of first non-speech, the first non-speech following the first portion of the first audio data; determining a second value representing a second time duration of the first non-speech; determining a first pause duration value by using the first duration weight factor to adjust the second value; and determining an endpoint based at least in part on the first pause duration value.
5. A computer-implemented method comprising: determining that received audio data corresponding to at least one utterance includes first audio data, wherein the first audio data corresponds to a first source direction; performing automatic speech recognition processing on the first audio data to determine a first hypothesis including one or more of at least one first word or a representation of at least one first word potentially corresponding to the first audio data; determining that a first portion of the first audio data corresponds to speech; determining a first value representing a first time duration of the first portion of the first audio data; determining a first duration weight factor based at least in part on the first value; determining, in the first hypothesis, a representation of first non-speech, the first non-speech following the first portion of the first audio data; determining a second value representing a second time duration of the first non-speech; determining a first pause duration value by using the first duration weight factor to adjust the second value; and determining an endpoint based at least in part on the first pause duration value. 10. The computer-implemented method of claim 5 , further comprising determining the second value by determining a number of audio frames corresponding to the first non-speech represented in the first hypothesis.