1. A neural network system comprising: a feedforward network comprising at least one neuron circuit for producing an activation function and a first derivative of the activation function; a weight updating circuit for producing updated weights to the feedforward network; and an error back-propagation network for receiving the first derivative of the activation function and to provide weight change data information to the weight updating circuit.