1. A mobile computing device, comprising: a processor configured to execute a speech recognition application that uses a multi-layered neural network as an acoustic model; and a hardware accelerator comprising: circuitry configured to receive matrix data representing one or more frames of an audio signal as input data for a first layer of the neural network; a multiplier-accumulator (MAC) unit configured to: multiply the received matrix data representing one or more frames of the audio signal with a weight matrix; add a bias matrix to the multiplication results; and accumulate the addition results; circuitry configured to pass the accumulated results through an activation function to generate an output matrix representing an output of the first layer of the neural network for the frame; and a data transceiver configured to receive and decode weights and bias terms data, the data transceiver including: a decompression unit configured to: decompress compressed weight and bias terms data, and double buffer decompressed weights and bias terms data to allow for parallel decompression and MAC unit operations.