Difference between binary cross entropy and categorical cross entropy? With binary cross entropy, you can only classify two classes. With categorical cross entropy, you're not limited to how many classes your model can classify.