1. A system for solving an adaptation problem, comprising: an interconnected neural network with a plurality of neurons, each neuron having an output and a plurality of inputs, said output of each said neuron being connected with connection weights to said inputs of all other neurons, each neuron generating an output value by binarizing a summation of inputs from other neurons that are weighted by said connection weights; and a calculation portion for receiving said output values generated by said neurons, for calculating a cost function based on said output values, for calculating a difference between said cost function calculated currently and said cost function calculated previously, for calculating a change of said connection weights of one or more neurons according to said difference in cost functions, and for changing said connection weights of at least one of said neurons according to said calculated change of said at least connection weights, wherein said connections weights of one or more neurons are successively changed until a predetermined condition is satisfied.