Questions tagged [confusion-matrix]
A confusion matrix is a contingency table used to evaluate the predictive accuracy of a classifier. Confusion matrix is the 2x2 frequency table with counts "True positive", "True negative", "False positive", "False negative", relating classifying to a class of interest vs. else class. But in a broader sense, any frequency kxk crosstabulation "Predicted" x "Actual" classes can be called a confusion matrix, in the context of evaluation of a classifier.
297 questions
0 votes
0 answers
89 views
Can I use confusion matrix for prediction?
TLDR : confusion matrix is used to validate a model. But I also want to make predictions using my models. Can I use the confusion matrix to make predictions? I don't see any other way to do it, but I ...
- 23
0 votes
0 answers
55 views
Calculating Precision and Recall in Spell Correction when the input sentence has no errors
I am doing a project on spell correction. While evaluating the model results, I came across this situation: the input sentence has no errors, and the model outputs the input sentence as it is, which ...
1 vote
0 answers
104 views
Best way to solve a multi-class thresholding problem?
I have a multi-class classification problem, where I classify my images into n classes and also a background class. I am currently trying to figure out how to find the optimal thresholds (for each ...
- 11
5 votes
3 answers
889 views
Judging a model through the TP, TN, FP, and FN values
I am evaluating a model that predicts the existence or not existence of a "characteristic" (for example, "there is a dog in this image") using several datasets. The system outputs ...
- 257
2 votes
3 answers
804 views
Is relying on just the confusion matrix for highly imbalanced test sets to evaluate model performance a bad idea?
I have a binary classification model with a test set that is highly skewed, the majority class 0 is 22 times greater than the minority class 1. This causes my Precision to be low and Recall to be high,...
- 21
4 votes
2 answers
263 views
Linear algebra properties of a confusion matrix (eigenvalues, eigenvectors, and determinants)
This answer to a question on Math Stack Exchange got me thinking about a confusion matrix as more than just a rectangular array of numbers. We don’t talk about a confusion matrix as a linear ...
- 72.8k
0 votes
1 answer
161 views
Matthews' Correlation Coefficient and Leave-One-Out Cross Validation
How do I determine Matthews' Correlation Coefficient for leave-one-out cross-validation? There doesn't seem to be a way to average the coefficient across folds - one element is insufficient support ...
- 13
2 votes
1 answer
2k views
Imbalanced classes and possible ways to increase precision, recall and f1-score of the prediction model
I've just started my data science internship, and this is my first time in the field. I'm sure I'll face challenges in the future where I might need your help. It's also my first time asking a ...
