Questions tagged [rating]
"A rating is the evaluation or assessment of something, in terms of quality (as with a critic rating a novel), quantity (as with an athlete being rated by his or her statistics), or some combination of both" (Wikipedia).
178 questions
1 vote
0 answers
24 views
Independent raters used as parametric modulators in fMRI [closed]
I have fMRI data from participants watching videos. They were not making ratings in the scanner, and did not make ratings post scan. Is it possible to obtain ratings from an independent sample of ...
- 335
2 votes
0 answers
34 views
handling a variable number of comparisons
In tournament Bridge the same distribution of cards is played at more than one table. Your result is based on how you went compared to players holding the same cards at other tables. Now suppose you ...
- 21
9 votes
3 answers
1k views
How to handle bias in 1-5 star ratings?
I was discussing with a friend my bad experience with a health insurance company, and as support for my impression, I pointed out to her that trustpilot gave it a very low score. There were 70 reviews,...
- 831
11 votes
3 answers
378 views
How can I order or sort many distributions, then summarize the "quantiles" of this ordered list?
What are the best practices for sorting a large number of distributions? What are some of the pros and cons of different ways to do this? Let's say I am working with Likert responses to a survey ...
- 5,723
1 vote
1 answer
132 views
How do I compute the intra-rater intraclass correlation for a study design with some repeated measures?
How do I compute the intra-rater intraclass correlation for a study design with some repeated measures? The study had approximately 1000 subjects rated (continuously 0-100%) by 500 raters. Each rater ...
- 131
4 votes
1 answer
109 views
Multilevel Modeling in Linear Mixed Models versus Generalized Linear Mixed Models
I am analyzing a data set that includes several discrete and continuous outcome variables (DV). For the continuous DVs I intend to use Linear Mixed Models (LMM) processed in SPSS. For the discrete ...
- 135
7 votes
2 answers
249 views
(Mixed-)model specification and comparison for testing hypotheses concerning continuous ratings
In a behavioral study following a within-subjects design, subjects of various levels of musicality (years of education) gave continuous liking ratings of three audio stimuli, each under three ...
- 2,372
1 vote
0 answers
101 views
Modeling player interactions in multi-dimensional rating systems
In traditional rating systems (such as Elo), a player's strength is represented by a single scalar value, which is assumed to be consistent across different opponents. However, in some games, the ...
- 11
2 votes
0 answers
63 views
Best way of determining how unique an inspector's ratings are compared to the average inspector
Noob question. I have a full population of every inspector rating for all items being rated. Each inspector has inspected a subset of the items and given them a rating, but different inspectors have ...
1 vote
1 answer
540 views
Normalizing a data set by using z-scores from a related data set
I am trying to come up with a normalization for a set of data. My company puts our products through a series of testers (people) to score our products on key metrics. I am able to access all records ...
- 13
1 vote
1 answer
87 views
Should I treat a single response as multiple ones in separate models?
I have this data where participants listened to each stimulus and gave a rating (1~5) for each. But each stimulus contains multiple sentence-like units (i.e., intonational phrase) within it, and for ...
- 11
8 votes
4 answers
2k views
On the cradle of the Elo Rating System, and how to find it
A definitive proposal can be found in: Elo, Arpad E. (August, 1967). The Proposed USCF Rating System, Its Development, Theory, and Applications. Chess Life XXII (8): 242-247. How exactly are THE ...
- 318
2 votes
0 answers
73 views
Dynamic Time Warping with polarity?
I am trying to quantify the cumulative difference between two time series using dynamic time warping. For example, here I calculated and plotted the DTW distance between Speaker rating (pink line) and ...
- 21
1 vote
0 answers
121 views
A Rating Formula that Combines Two Metrics
If I have two metrics, - number of reviews and the rating out of 5, and I want to combine them into a single meaningful rating that can rank a list, how can I do that? For example, let's say I have ...
- 11
3 votes
1 answer
77 views
What are some techniques to calculate the highsest average when the number of data points is important?
A very simple example here would be restaurants with online reviews. On a platform where every resturant might have a different number of reviews with a vote ranging from 1 to 5, which restaurant is ...
- 131