Questions tagged [bic]
BIC is an acronym for Bayesian Information Criterion. BIC is one method of model comparison. See also AIC
355 questions
0 votes
0 answers
36 views
How should I combine BIC across wavelength-binned fits to get one “overall” criterion?
I am extracting spectra in $m$ wavelength bins. To clarify my setup: I split a time-series spectrum (from a telescope observation of a transiting planet) into m wavelength bins and fit a light curve ...
0 votes
1 answer
52 views
Why do overfitted models in finite mixture regression sometimes have the smallest BIC despite the true number of components being selected frequently?
Learning about EM algorithms and finite mixture models and I've run into a particularly unintuitive problem. I'm trying to fit a finite mixture regression model on simulated data, where the true ...
0 votes
0 answers
32 views
Question about AIC/BIC as defined in Time Series Analysis and Its Applications by Shumway and Stoffer
In the 5th edition of the book, they define AIC, AICc and BIC as: $\mathrm{AIC}=\log \hat{\sigma}_k^2+\frac{n+2 k}{n}$ $\mathrm{AICc}=\log \hat{\sigma}_k^2+\frac{n+k}{n-k-2}$ $\mathrm{BIC}=\log \hat{\...
1 vote
1 answer
119 views
How to calculate BIC values for logit models using the survey package in R?
I am using lumley's survey package in R to estimate logit models and I want to compare BIC statistics of several nested models. Given that they are not estimated with maximum likelihood, I am having ...
0 votes
1 answer
92 views
How to get a smaller number of optimal K in K-means clustering
I want to obtain a small optimal value of $k$ (with $k ≤ 5$) for k-means clustering on a dataset of size $5000$. I have used the BIC and the Gap statistic to determine the optimal number of clusters, ...
1 vote
1 answer
101 views
How to calculate the BIC for each mixture component
I want to fit a mixture of Gaussian to simulated data. Then, I need to calculate the Bayesian information criteria for each mixture component. My point is that, after the model convergence, I ...
0 votes
0 answers
36 views
Literature on the usage of multiple regressions to validate an hypothesis using multiple variations of variables
I'm trying to show that in an equation of the form var1 ~ var2 + var3 + ... + varX, var2 has a has a statistically significant effect. However, there are many ways of defining var1, var3... varX (var ...
4 votes
1 answer
214 views
Effect of sample size on BIC
The BIC is given by $$BIC = k\ln(n)-2\ln(\hat{L}).$$ Let's say I have a Gaussian model to which I'm fitting a dataset-- pretty typical stuff. The log-likelihood for the Gaussian model is given by $$\...
3 votes
2 answers
248 views
How compute a BIC for multivariate regression?
I would like to know if it is possible to compute a BIC for a multivariate regression (One predictor X and 3 responses outcomes Y). If yes, how? In R, when I run: ...
1 vote
0 answers
43 views
comparing non-nested models with different specifications based on AIc/BIC criteria
I am trying to determine if I can use the AIC/BIC criteria for model selection in the case of a multivariate probit model. I have two models with different specifications: e.g. Model-1: mvprobit ( $...
1 vote
1 answer
90 views
When does a extended BIC curve for a Gaussian Graphical model/GLasso look incorrect?
I have a model for a network, and I wanted to analyze the extended BIC curve for a graphical lasso model as according to Foygel and Drton 2010. The paper gives a list of assumptions for the data/model ...
0 votes
2 answers
134 views
Negative log-likelihood, high BIC, high R-squared, low error, using a difference-in-differences (DiD) methodology [closed]
I am trying to see the impact of Brexit on UK imports. My dependent variable are EU exports to the rest of world. I have monthly data from 2013 to 2023, also data is in billions of GBP. When I do ...
9 votes
0 answers
162 views
Any Insights on the adoption and use of the Healthy Akaike Information Criterion (hAIC)?
Recently, I came across the Healthy Akaike Information Criterion (hAIC), introduced by Demidenko in his 2004 book "Mixed Models: Theory and Applications with R." Despite its (potential) ...
2 votes
1 answer
105 views
BIC with non-negligible priors
I want to do model selection based on the best-fit/MAP/marginal posterior I find from an MCMC and likelihood maximization. I have a likelihood $\mathcal{L}(X|\theta)$, some informative priors $\pi(\...
1 vote
0 answers
127 views
Is comparing the AIC of a Bayesian and a frequentist model right?
I’m trying to fit a general linear model where the dependant variable is a probability. It is zero-inflated and continuous, then following the advice here blog of Ben Bolker, I separated my data pool ...