Now we can make the claim that every time the perceptron makes a mistake, the square distance to all the generously feasible weight vectors will be decreased by at least the squared length of the input vector, which is the update we make. 