0
$\begingroup$

I have a dataset with answers to an online survey from ~800 participants. These participants can be divided into 5 groups. We can call the groups A, B, C, D and E. I'm interested in three different types of comparisons: A vs B; A+B vs C+D+E; C vs D. I will use ordinal logistic regression (OLR) for the analysis.

My question is: should I run only one OLR and then look at the post hoc comparisons I am interested in, or run three different OLR, one for each of the comparisons I'm interested in?

If I run just one test with all groups together, I am accounting for multiple comparisons, but I am also losing power since I'm doing a bunch of comparisons I'm not really interested in.

If I run three tests, one for each comparison, then I'm comparing exactly the right groups, but I don't want to cheat on the multiple comparisons problem.

Improve this question
$\endgroup$

1 Answer 1

Reset to default
0
$\begingroup$

Generally it is considered better to fit one model using all of the groups, and then do post-hoc tests afterwards. This will give a consistent analysis, and is generally more powerful.

Some similar questions with answers:

Improve this answer
$\endgroup$

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.