The reactions to the ratings are flowing in, and I noticed there are some misunderstandings on how to interpret the ratings, and how to calculate a percentile.\u00a0 First of all, the ranking is based on the category.\u00a0 That is, if your game is in “48h compo” it is ranked within a total of 1610 games, if it’s “jam”, within 736 entries.\u00a0 But that is not the whole story.\u00a0 A number of games have not been rated because the number of ratings fall below the threshold (which I believe is 12 or 14 ratings or some such).\u00a0 Without knowing how many games were not rated, you can’t calculate your percentile.\u00a0 As a first attempt to solve this problem, I took a random sample out of all games, and noted the percentages that were and weren’t rated. Figures calculated from all games would be nice to have, but these aren’t available afaik.<\/p>\n
Percentage of 48h games rated: 88.9% (32 out of 36 in my sample)
\n Percentage of Jam games rated: 64.5% (20 out of 31 in my sample)<\/p>\n
Note that the percentage for Jam games is much lower for some reason.\u00a0 Anyway, this means the total number of rated<\/strong> games in each category is approximately:<\/p>\n 48h: 1431 (1610*0.889) UPDATE: thanks to ashdnazg<\/a>, we now have\u00a0accurate numbers!<\/a><\/p>\n 48h: 1357<\/strong> To get your percentile, divide your ranking by one of the numbers above and multiply by 100.<\/p>\n Also it makes sense to look at the absolute ratings (the number of stars) and to know something about the relationship between absolute and relative ratings.\u00a0 In some cases, a 0.1 star change can drop or raise your ranking by 100 or so.\u00a0 I’d also like to see a graph of this relationship.\u00a0 Maybe I’ll make one myself.<\/p>\n <\/p>","time":"May 21st, 2013 3:00 am","title":"Technical note: how to interpret ratings"}
\n Jam: 474 (736*0.645)<\/p>\n
\n Jam: 566
\n <\/strong><\/p>\n