Questions tagged [empirical-likelihood]
The empirical-likelihood tag has no summary.
20 questions
2 votes
1 answer
271 views
Maximum Likelihood, Cross-Entropy, and Conditional Empirical Distributions for Conditional Models
I came across this article: “MSE is Cross Entropy at Heart: Maximum Likelihood Estimation Explained” which states: "When training a neural network, we are trying to find the parameters of a ...
2 votes
0 answers
102 views
What do Efron & Tibshirani mean by the 'empirical exponential family' in the textbook 'Introduction to the Bootstrap'?
I would like to understand what Efron & Tibshirani mean by 'empirical exponential family' in the textbook 'Introduction to the Bootstrap' (formula 21.84 for instance)? The explanation there is too ...
0 votes
0 answers
441 views
Standard Deviations of Detrended Data vs Original Data
I'am interested to know the opinion on this matter. I have Data of a Financial Security. The goal is to view the Standard Deviations levels of the data to possibly see patterns of behavior of the ...
1 vote
1 answer
92 views
Paper that proposes an algorithm for a optimal stoping rule based on an empirical distribution
Can you suggest me a paper that proposes an optimal stoping rule based on an empirical distribution? I am looking for some like this: I observe a random variable $x$ for a given time (this is usually ...
0 votes
0 answers
179 views
How does the Empirical Rule align with Tolerance Interval
For Empirical Rule, 95% of the observed data will occur within the second standard deviation, but what is the difference between this and the 95/95 2-sided tolerance interval ? It includes 95% of ...
1 vote
0 answers
62 views
Can use pseudo maximum likelihood method with mixed continuous and discret data in copula
For copula models there are different estimation ways. One of them, is Pseudo maximum likelihood method. In this method, the margins are estimated using empirical cumulative density function. Then ...
1 vote
0 answers
78 views
Is this empirical likelihood parameter identified?
I am writing my empirical likelihood function, but I do not know whether my model parameters can be identified. The data contains 4 columns, Z is treatment assignment, D is treatment, Y is metric and ...
7 votes
1 answer
3k views
Maximum likelihood as minimizing the dissimilarity between the empirical distriution and the model distribution
I am reading Ian Goodfellow "Deep Learning" book. At page 128 it says One way to interpret maximum likelihood estimation is to view it as minimizing the dissimilarity between the empirical ...
4 votes
1 answer
132 views
Use MLEs to choose the 'most likely' from a set of distributions?
Would it be valid to choose a probability distribution for assumptions based on the actual maximum likelihood of various distributions derived from MLE estimates? For example, suppose I find MLE ...
0 votes
1 answer
412 views
How to correlate statistics empirical rule to P value?
I have data from 2 tools which indicate performance, golden tool and new tool. I can calculate mean value and standard deviation value for each of these 2 samples. I want to quantify if the new tool ...
1 vote
0 answers
155 views
How to kernalize a logistic loss based regularized ERM optimization problem?
Given $\{\mathbf{x}_i,y_i\}, i=1,\ldots,m$, consider the following optimization problem: $\min\limits_{\mathbf{w},b} \sum\limits_{i=1}^{m}\log(1+\exp(-y_i(\mathbf{w^Tx_i} + b)))$ $+\lambda|| \mathbf{...
8 votes
2 answers
12k views
Empirical PDF from Empirical CDF
Suppose I do an experiment $N$ times and get a vector $X$ of results. Let $C_X(y)$ be the empirical cumulative distribution function of $X$. Suppose $X$ is sorted so that $x_1 \leq x_2 \cdots \leq ...
1 vote
0 answers
121 views
Given two empirical distribution A and B, how to setup a hypothesis test to test if a new data point is from distribution A?
I have two empirical distribution A and B (i.e. two continuous datasets in $\mathcal{R}$) and I am trying to set up a hypothesis test to test if a new data point is from distribution A. Naturally ...
4 votes
0 answers
147 views
Understand the empirical likelihood
When I read the talk notes by Owen about empirical likelihood, http://www.ms.uky.edu/~mai/sta709/Owen2005.pdf I am confused about the solve of solution when I read the page 24. Let's say we want to ...
3 votes
0 answers
347 views
JuliaOpt Empirical Likelihood Estimation
I am trying to perform an empirical likelihood estimation in a regression setting using JuliaOpt (Convex or JuMP) and ran into difficulties using either API. The problem: Empirical likelihood for ...