Saturday, June 1, 2013

Top and Bottom Performers May Look Alike

We just saw and immensely enjoyed a movie that our local film critic had rated 1 on a 5 star scale.  We found the entertainment value to be close to 5 stars.  If you average our ratings you get 3 stars.  This is a prime example of how meaningless average ratings can be when there are only two raters, and the absolute ratings are at the top and bottom of the scale.

It would be far more meaningful to know that two raters gave absolutely different assessments, and understand why.

2 comments: