Iteratively construct Linear Classifier
Your algorithm is very similar to a Genetic Algorithm, which has almost the same 3 iterative steps.

You would be missing a Termination condition to end the search for an answer, once your reach an acceptable one.

You can probably adapt your algorithm to fit under a formal GA search heuristic.