Questions tagged [auc]

Question 1

I have some functions which take in multinomial classification results and plot them on a graph. Of the five models, LDA (in orange) seems to be the most performant. (all other information is show on ...

Question 2

I’ve been reading some papers in the neuroscience field, and I don’t quite understand the widespread use of AUC/ROC to test for group differences when analyzing neuronal firing over a range of seconds ...

Question 3

I have two binary classifiers and would like to check whether there is a statistically significant difference between the area under the ROC curve (AUROC). I have reason to opt for AUROC as my ...

Question 4

I'm using two independent predictors, A and B (Pearson correlation = 0), both standardized to the same scale, to predict a binary disease outcome using logistic regression. I'm comparing two modeling ...

Question 5

I am working on evaluating an explainability method for a text classification model that predicts whether a given text sequence contains hate speech or not. The method outputs token-level importance ...

Question 6

Can AUC be used for model selection, and how can the excessive number of features/parameters be penalized in this case? In frequentist framework we have various model selection criteria, like AIC, BIC,...

Question 7

I have written an SQL function to calculate the Area Under the Curve (AUC) based on rank-sum. However, when I compare the AUC values with F1 scores, I notice something strange: The model with the ...

Question 8

Im carrying out an external validation of a cause specific Cox model and would like to present the AUC and its confidence interval. I’ve seen several places where it’s described how a normal ...

Question 9

An influential 2009 paper, Measuring classifier performance: A coherent alternative to the area under the ROC curve, argues that the Area Under the Curve (AUC) "is fundamentally incoherent in ...

Question 10

When we try to determine the optimal threshold for a continuous predictor variable, we draw a ROC curve and calculate the AUC value. If AUC<0.5 this means that the predictor has an inverse ...

Question 11

I am working on a radiology AI project that aims to detect and classify lesions (aka abnormalities) in CT scans across multiple organs. The test set (n=200) is a mix of normal scans (50%) and abnormal ...

Question 12

Testing the difference between two AUCs seems to be straightforward. There are some relevant sources, like this one and links therein. I have an extremely simple case of two ROCs, similar to this ...

Question 13

When I got into Machine Learning over 15 years ago, I learned that AUC stands for "Area Under the Curve", meaning "area under the ROC curve" and ROC being the "Receiver ...

Question 14

I understand that AUC measures the model's ability to rank the subjects (see Why is ROC AUC equivalent to the probability that two randomly-selected samples are correctly ranked?). In contrast, binary ...

Question 15

Since the F1-score is threshold-dependent, would the area under F1 across all thresholds be an informative metric?

Stack Exchange Network

Questions tagged [auc]

deciding on a threshold for multinomial classification

What are the limitations of AUC/ROC when used to evaluate effects over time (e.g., drug, electrophysiological signals) in inferential models?

Comparing AUROCs of binary classifiers across cross-validation folds: alternatives to DeLong

Combining vs. Separating Predictors: What’s Better for Prediction

Evaluation of token importance attribution based on human rationales

Number of features selection using AUC

SQL Function for AUC Calculation Producing Unexpected Results

Time dependant AUC confidence interval using normal approximation

Misgivings about the notion that AUC is an incoherent model comparison method

ROC curve threshold/cut off values

Test of AI model performance doing combined tumour detection and classification

Testing the difference between two AUCs [duplicate]

Is the term "AUROC curve" actually correct or meaningful when referring to the curve itself?

Relationship between AUC and Cross-entropy

Area under the F1 curve

Hot Network Questions