In the 5-fold cross validation, AUC-ROC and Accuracy were calculated to quantify model performance. In the hold-out test, in addition to AUC-ROC and accuracy, sensitivity, specificity, Youden's index, MCC (Matthews Correlation Coefficient), false rate, F-measure were calculated using the confusion matrixes in Microsoft Excel (version Office 365) in order to examine the extrapolation of the model in detail.