Questions tagged [ranking]
Ranking is the task (for respondents) or the result of ordering the given stimuli or performers from "highest" to "lowest" (or *vice versa*) in some respect. It is usually contrasted with rating of stimuli. (For ranking as a way of data transformation - use tag [ranks]).
665 questions
0 votes
0 answers
44 views
Report on ranked choices; margin of error
If every respondent to a survey like this simply ranks the alternatives, is the result seen here done by just averaging the ranks and then sorting them? And what in the world does "margin of ...
3 votes
0 answers
70 views
Test whether two groups are drawn from the same Mallows distribution
Question I'm attempting to test whether two sets of preferences are drawn from the same Mallows (1957) distribution using the BayesMallows package. To give a concrete example, suppose I have ten men ...
3 votes
1 answer
78 views
Design of experiments/Fractional factorial design where each experiment is a pairwise comparison
I am developing a program that involves multiple design decisions. For example, the first algorithm in the chain could be A, B, or C. The second decision involves choosing between parameters 1, 2, 3, ...
0 votes
0 answers
35 views
Estimating "true" percentile ranking based on previous rankings within random samples
I'm trying to model athletic competition and competitor ranking, in a sport such as running. A particular competitor will participate in some number of races each season. Some small, some large. They ...
0 votes
0 answers
42 views
Comparing/scoring/ranking many candidate features fit using splines
I have about 100 biomarkers (serum protein concentrations; continuous) from about 200 subjects that could correlate with prognosis (binary, prevalence around 30%). The data are complete in that all ...
1 vote
0 answers
79 views
How to test local maxima with interval location
Consider the following plot, which shows a noisy function 'Firing Rate' and some highlighted intervals. I want to test whether these intervals tend to overlap or correlate with local high-valued (e.g. ...
0 votes
1 answer
77 views
Questions on comparing three different groups' ratings
I’m currently comparing perceived career barriers among three groups: students, faculty, and industry professionals. While I used the same survey questionnaire with a Likert scale (e.g., “Job ...
1 vote
1 answer
76 views
Testing if observations in repeated measurements show a consistent order?
I have to analyze a biological dataset. Let me describe the experiment and data first: We have a piece of plastic with hundreds of wells where chemical/biological ...
3 votes
0 answers
113 views
Machine learning model for ranking that outputs probabilities
Traditionally ML algorithms for ranking take the features as input and then output a "relevance score" which do not have a natural probabilistic interpretation. For example, suppose we have ...
0 votes
1 answer
74 views
Generalization of ranking correlation
I have a system that produced $n$ outputs, and two annotators have judged them. Each annotator produced a ranked list of $n$ items. I have measured how they correlated by computing a ranking ...
3 votes
1 answer
94 views
Ranks for an Asymmetric Independent Variable
I am analyzing data with a regression model where the independent variable of interest is a treatment, and I want to estimate its effect. I aim to adjust this estimate for a set of covariates, ...
3 votes
1 answer
208 views
Most Natural Class of Machine Learning Models for Group Data
I have a dataset of performance of students in exams which looks like: ...
5 votes
1 answer
418 views
XGBoost/ XGBRanker to produce probabilities instead of ranking scores
I have a dataset of the performance of students in exams which looks like: ...
0 votes
1 answer
72 views
Survey with forced ranking
I have created a survey with a ranking scale of 1 = Least effective, 2= Somewhat effective 3= Effective 4 = Most effective. People answering the questions were forced to select only one response per ...
4 votes
2 answers
665 views
Relationship between AUC and Cross-entropy
I understand that AUC measures the model's ability to rank the subjects (see Why is ROC AUC equivalent to the probability that two randomly-selected samples are correctly ranked?). In contrast, binary ...