1. A computer-readable storage, having stored thereon a computer program for processing speech audio in a network connected client device, said computer program having a plurality of code sections executable by said client device for causing the client device to perform the steps of: selecting a speech grammar for use in a speech recognition system in the network connected client device; characterizing said selected speech grammar, wherein said characterization comprises determining a size and a complexity of said selected grammar and a preferred processing location is specified in said selected grammar; determining a processing power of said client device and of a remote speech server, a speed of a network connection between said client device and said speech server, and a feedback requirement for said speech recognition system; and, based on the characterization of said selected speech grammar, said determined network connection speed, said determined processing power of the network connected client device and the remote speech server, and said feedback requirements, electing whether to process the entire selected speech grammar in said preferred location or another location different from said preferred location before processing the speech audio, wherein said preferred location specifies the network connected client device or the speech server, wherein if said preferred location specifies said speech server, said client device elects said client device if real-time feedback is required by said speech recognition system and a processing power of said client device is sufficient for said client device to process said selected grammar in real-time based on said size and said complexity of said selected grammar, and wherein if said preferred location specifies said client device, said client device elects said remote speech server if a latency in processing said selected speech grammar based on said network speed and said remote speech server processing power is sufficient to meet a feedback requirement of said speech recognition system.