Training binary classifier on only one data point ( Theoritical question)
It may predict either a cat or a dog depending on your descriptor for cats and dogs, and on your learning algorithm. This is illustrated on the picture below. If the mirrored cat happens to be on the same side of the separating line as the training cat, then it will be classified as a cat. Otherwise, it will be classified as a dog.