1. A spoken language understanding (SLU) system, comprising steps of: receiving a sequence of words corresponding to one or more spoken utterances of a user; passing the sequence of words through a spoken language understanding module to produce a sequence of intentions; passing the sequence of words through a first subnetwork of a multi-scale recurrent neural network (MSRNN); passing the sequence of intentions through a second subnetwork of the multi-scale recurrent neural network (MSRNN); combining outputs of the first subnetwork and the second subnetwork to predict a goal of the user, wherein the steps are performd in a processor.