1. A method comprising: receiving, by a computing device, audiovisual input comprising audio input and video input associated with a subject; extracting, by the computing device, visual features from the video input; applying, by the computing device, a scattering operation to the extracted visual features to generate a vector of scattering coefficients in a first dimensional space; providing the vector of scattering coefficients as input to a first neural network for visual processing; generating, by the computing device and using the first neural network, a first prediction regarding a speech status of the subject based on the vector of scattering coefficients; providing the audio input to a second neural network for audio processing; generating, by the computing device and using the second neural network, a second prediction regarding the speech status of the subject based on the audio input; comparing, by the computing device, a first output of the first neural network with a second output of the second neural network to determine a synchrony state of the audio input and the video input, wherein the synchrony state indicates whether the audio input is in-sync with the video input; and storing the synchrony state of the audio input and the video input.
1. A method comprising: receiving, by a computing device, audiovisual input comprising audio input and video input associated with a subject; extracting, by the computing device, visual features from the video input; applying, by the computing device, a scattering operation to the extracted visual features to generate a vector of scattering coefficients in a first dimensional space; providing the vector of scattering coefficients as input to a first neural network for visual processing; generating, by the computing device and using the first neural network, a first prediction regarding a speech status of the subject based on the vector of scattering coefficients; providing the audio input to a second neural network for audio processing; generating, by the computing device and using the second neural network, a second prediction regarding the speech status of the subject based on the audio input; comparing, by the computing device, a first output of the first neural network with a second output of the second neural network to determine a synchrony state of the audio input and the video input, wherein the synchrony state indicates whether the audio input is in-sync with the video input; and storing the synchrony state of the audio input and the video input. 4. The method of claim 1 , wherein the video input is sampled at a first frequency and the audio input is sampled at a different second frequency.