1. A method comprising: receiving, by a processing device, a training data set that includes a plurality of positive examples of sensitive data and a plurality of negative examples of sensitive data; analyzing, by the processing device, the training data set using machine learning to train a machine learning-based detection (MLD) profile, the MLD profile to be used to classify new data as sensitive data or as non-sensitive data; and computing, by the processing device, a quality metric for the MLD profile.