1. A method comprising: receiving, by a computing device, a sequence of consecutive audio signals, the sequence including a first audio signal at a first time and a second audio signal at a second time later than the first time, wherein the audio first signal and the second audio signal include speech content; selecting, by the computing device, a speaker-specific profile based on speech characteristics determined from one or more of the audio signals of the sequence; applying a speaker-specific feature transform to the first audio signal to obtain a transformed audio signal, wherein the speaker-specific feature transform is determined based on one or more speaker-specific speech characteristics of the selected speaker-profile; processing, by the computing device, the transformed audio signal using a neural network trained to estimate a given speech content of the first audio signal; modifying the speaker-specific feature transform based on an output of the neural network to obtain a modified speaker-specific feature transform; and applying the modified speaker-specific feature transform to the second audio signal to obtain a respective transformed audio signal to be processed by the neural network to estimate a respective speech content of the second audio signal.