Questions tagged [mae]
The Mean Absolute Error (MAE) is a point forecast accuracy measure. In the forecasting literature, Mean Absolute Deviation (MAD) is used interchangeably.
96 questions
0 votes
0 answers
21 views
Evaluating predictive accuracy (MAE) from ordinal outcomes using cumulative link mixed model
Hello everyone, I recently ran a mobile phone–based Experience Sampling Method (ESM) study where, over 7 days, participants were prompted 5 times per day (semi-random intervals within wake/sleep ...
0 votes
0 answers
29 views
How do you decompose MAE into bias and variance components? [duplicate]
We have the well known bias-variance tradeoff for MSE of an estimator $\hat f(x)$: $$MSE(\hat f(x)) = \text{bias}(\hat f(x))^2 + \text{Var}(\hat f(x)) + \sigma^2$$ So with this we can explain why, for ...
1 vote
0 answers
201 views
Error in fitting Zero inflated negative binomial in Python using cross validation
I want to assess predictive power of zero-inflated negative binomial model in Python. My steps are listed as below: Regarding 5-folds cross-validation: Fit multiple Zero-Inflated Negative Binomial (...
3 votes
2 answers
483 views
Machine learning benchmarks: MAE, RMSE, and R-squared
I'm working on a machine learning problem, and I'm having trouble interpreting different measures of model performance. I have a single dependent variable (proportion change between two treatments, ...
5 votes
2 answers
2k views
What is an intuitive explanation for why my mean absolute error converges to 66.6%?
Let's assume I have actual numbers (randomly generated) between 1 and 1000. Let's further assume, my prediction model tries to predict the actual numbers. My "forecasting" model is a monkey ...
1 vote
0 answers
23 views
Interpret Mean vs. SMAPE results [duplicate]
I have following dataframe: ...
4 votes
2 answers
3k views
Can someone help me understand why the MAE, MSE and RMSE scores for my regression model are very low but the R2 is negative?
I am using a random forest regression model to make predictions and leave one out cross validation for my prediction task. I am having a difficult time understanding why my R2 score is negative when ...
1 vote
1 answer
276 views
Why can LASSO MAE be worse than individual feature linear regression MAE?
I am comparing the MAE of LASSO regression of multiple features vs. MAE of linear regression of each individual feature, and I am having trouble understanding why the LASSO MAE can be worse than some ...
1 vote
1 answer
563 views
Equivalent of $E[(a-X)^2] = E[(a-E(X))^2] + Var(X)$ for $E[|a-X|]$ and $med(X)$?
The minimzer of the MSE $E[(a-X)^2]$ is $a=E(X)$, and the MSE can be decomposed into $E[(a-X)^2] = E[(a-E(X))^2] + Var(X)$. I am wondering whether there exists a similar expression th MAE $E[|a-X|]$ ...
1 vote
1 answer
1k views
A Higher r-squared always implies a reduction in MAE and RMSE?
I apply 2 different machine learning models in my data, a Multiple Linear Regression and Random Forest. The results were bellow: Why the MAE and RMSE are higher for a higher R-squared? Both models ...
2 votes
1 answer
590 views
Percentage change in RMSE (or MAE) over models
Let's say I have two different models of an outcome Y, m1 and m2 and perform some kind of cross-validation. I calculate the RMSE and the MAE on the test set (for the two models) and I want to say ...
1 vote
2 answers
860 views
Giving more importance to under prediction (mean absolute error) than over prediction for forecasting
Just curious to hear any thoughts on weighting over prediction in mean absolute error to minimize the penalty since I'm more interested in under prediction, if that makes sense. Basically, I'm ...
1 vote
1 answer
3k views
How to interpret MSE, RMSE and MAE
I understand in general MSE, RMSE and MAE means average distance between the actual and predicted value, and the lower the MSE, RMSE and MAE, the better the model fits the dataset. I try to understand ...
5 votes
2 answers
6k views
MAE vs MSE for Linear regression
Several articles says that MAE is robust to outliers but MSE is not and MSE can hamper the model if errors are too huge. My question is that MSE and MAE both are error matrices, our priority is to ...
1 vote
1 answer
228 views
Are MAE and RMSE possible ways of choosing between ols and types of glm?
I have a longitudinal data set and have fit a number of different regression models [ols, poisson, binomial....and more]. I want to justify the final model selection and assumed one method might be to ...