unit-testing Machine Learning models
In the above case, you can collect annotated data ( which is not seen by the model during training) and validate the predictions made by the model.
And another way is if you are a domain expert or have sufficient knowledge on the data, you can tweak the input values and test the predicted output with your expected output.