1. A method of training an embedded speech recognizer on an electronic device in a distributed speech recognition system comprising the electronic device and a network device having a remote speech recognizer remote from the electronic device, the method comprising: sending, to the network device, input audio received by the electronic device; receiving, from the network device, a remote speech recognition result corresponding to the input audio; and training the embedded speech recognizer based, at least in part, on the remote speech recognition result.