ROC curve and AUC

ROC curve (Receiver Operating Characteristic curve) is a curve drawn using the prediction probability given by the prediction model for binary classification. A solid yellow line in the graph indicates an ROC curve.

If the prediction model is making random predictions, the ROC curve will overlap the diagonal from lower left to upper right (dashed line on graph). The more the ROC curve swells to the upper left, the better the prediction model. It is difficult to understand the shape of the curve in detail, so it is a good idea to judge the quality of the model based on the size of the AUC.

AUC (Area Under the Curve) is one of the metrics indices for binary classification. Refers to the area under the ROC curve (yellow areas). The bigger, the better, at best 100%. The AUC value is 50% when the prediction model predicts randomly, and approaches 100% when the model predicts very accurately.

Unlike Accuracy, Recall, Precision, and F-score, AUC is not affected by the threshold value for obtaining the prediction result from the prediction probability, so it is often used as an evaluation value for the prediction accuracy of binary classification.