I have trained a model of [Ridge classifier](http://scikit-learn.org/stable/modules/generated/sklearn.linear_model.RidgeClassifier.html) on the following dataset:

X = [[2,1], [2,3], [1,2], [3,2], [5,2], [5,4], [6,3]]

y = [1, 1, 1, 1, 0, 0, 0]

In the second example i add a new example [12,8] to X and train. Why does regression behave in such way that it readjusts the boundary, kicking the example (5,4) on the other side ?

![linear_regression_1](https://image.ibb.co/i7RCQw/clf_1.png)
![linera_regression_2](https://image.ibb.co/ny9oyG/clf_2.png)