Questions tagged [equivalence]
An equivalence study is designed to test whether one treatment is nearly equal, or 'equivalent' to another.
183 questions
1 vote
0 answers
40 views
Compare two independent meta-analysis
I extracted the overall effect from an existing meta-analysis that I would like to compare with the overall effect of my meta-analysis by performing an equivalence test (These are two independent meta-...
- 83
4 votes
1 answer
199 views
What statistical method to use for fairness study on algorithm?
The algorithm is a classifier (C) that detects a person turnstile jumping. The goal is to determine if the classifier is biased on variable A (let's say gender). The criterion we selected is Equalized ...
- 143
3 votes
0 answers
67 views
Equivalency testing for binomial outcome
Supposing that I have data produced by three levels of a treatment. The outcome variable is binomial (presence/absence). How do I test for equality of two of the levels vs. a "standard" ...
- 1,541
4 votes
1 answer
80 views
Equivalence test for right-censored count data
How would I perform equivalence tests for right-censored count data? The outcome of interest is total seizures per a time period. However, the equipment used to record seizures stops counting at 40. ...
- 1,541
1 vote
2 answers
195 views
A test to check whether two sets of proportions are _not different_
Is there a test to check whether two small sets of proportions are significantly not different? For example, consider the two sets of proportions ...
- 679
1 vote
1 answer
130 views
Epsilon parameter of the tost() function in the 'equivalence' R package
This is my first time using an equivalency test. I am using the tost() function in the 'equivalence' R package, and I want to test the hypothesis that these two groups are equivalent: ...
- 111
4 votes
1 answer
266 views
Why do I get smaller degrees of freedom for the Scalar invariance model than the Metric one while testing measurement invariance?
I am trying to test the measurement invariance in my bi-factor model with CFA tests. I have 23 binary questions coded "correct" and "incorrect" and 3 different groups in my data. ...
1 vote
0 answers
134 views
Establishing the Smallest Effect Size of Interest (SESOI)
In my experiment design, I will be testing subjects multiple times under two conditions: in a controlled lab setting and in real-life situations. Testing subjects repeatedly is necessary as ...
0 votes
0 answers
97 views
What hypothesis test can test for *equivalent* variance, rather than different variance?
There exist many "variance equality tests", like the F-test and its more robust cousins: Levene's, Bartlett's, the Brown-Forsythe. Given two samples A and B with variances $\sigma_A^2$ and $\...
- 917
2 votes
0 answers
93 views
TOST procedure + power analysis: how to interpret t-value inside bounds
I conducted a TOST procedure according to the guidelines by Lakens [1] and received the results from the table below. For "discontinuity", "fragmentation" and "...
1 vote
0 answers
123 views
Controlling type II error with multiple comparisons
I am confused about how to perform correction for multiple comparisons in the case where I do not want to reject the null hypothesis. I am doing multiple ANOVAs where I would like to show that there ...
- 11
2 votes
0 answers
257 views
Equivalence test with random effects
I am designing an experiment where I will test different subjects’ multiple times under two different conditions (lab and real life) My hypothesis Is that that the subject will perform equivalent in ...
1 vote
1 answer
101 views
What to do when my sample size is small to demonstrate an equivalence study
I'm analyzing data from a study comparing 5 treatment arms. Women receiving ovarian stimulation for in vitro fertilization at different phases of the ovarian cycle. The treatment efficacy endpoint was ...
- 939
4 votes
1 answer
220 views
Bayesian ROPE (region of practical equivalence) for simultaneous comparison of multiple parameters?
I very much like the idea of the ROPE (region of practical equivalence) (e.g. see here), where you compute the posterior probability that a given parameter is in a previous range that counts as "...
- 55.4k
1 vote
1 answer
122 views
Lower limit p-value is significant but not the NHST p value in Equivalence testing, what's the interpretation? [closed]
I'm testing two groups for equivalence in exercise self-efficacy using the TOSTER package in R. I ran a Mann-Whitney U test (...
- 51