14. A system, comprising: a computer processor; and a memory containing a program, which when executed by the computer processor, performs an operation to detect a keyword in speech, the operation comprising: generating, from a sequence of spectral feature vectors generated from the speech, a plurality of blocked feature vector sequences, wherein each of the plurality of blocked feature vector sequences comprises a respective subset of the plurality of feature vectors, wherein each of the plurality of blocked feature vector sequences overlap adjacent blocked feature vector sequences by a predefined count of feature vector sequences; and analyzing, by a neural network, each of the plurality of blocked feature vector sequences to detect the presence of the keyword in the speech.
14. A system, comprising: a computer processor; and a memory containing a program, which when executed by the computer processor, performs an operation to detect a keyword in speech, the operation comprising: generating, from a sequence of spectral feature vectors generated from the speech, a plurality of blocked feature vector sequences, wherein each of the plurality of blocked feature vector sequences comprises a respective subset of the plurality of feature vectors, wherein each of the plurality of blocked feature vector sequences overlap adjacent blocked feature vector sequences by a predefined count of feature vector sequences; and analyzing, by a neural network, each of the plurality of blocked feature vector sequences to detect the presence of the keyword in the speech. 16. The system of claim 14 , wherein an output of the neural network comprises a sequence of labels, wherein each of the sequence of labels indicates whether the keyword is present in a corresponding blocked feature vector sequence, the operation further comprising: smoothing the sequence of labels to determine whether the keyword is in the speech.