1. A method comprising the following computer-executable acts: receiving training data for training a deep convex network that comprises a plurality of interconnected modules, wherein each module in the plurality of interconnected modules comprises a linear layer and a non-linear layer; and training a portion of the deep convex network in a batch-based manner based at least in part upon the training data, wherein training the deep convex network comprises learning a weight matrix corresponding to output of the non-linear layer of at least one module.