This data and the Itch rating system will be used to rank the games. As the ratings become available, I intend to make the process as equitable as possible. I will post the data and the ranking algorithms. I intend to make frequent backup copies of the spreadsheet to help with data validation and security. (I’m a little gun-shy about the rating system. ) To quote a famous bus conductor, “I hope it’s NOT going to be a bumpy ride.”)
This might be off topic, but I’ve been lurking in the discussions about scoring schemes and am curious about this proposed two-track rating scheme. How will this work? What if there are more people rating on itch than on the form (seems very likely), or vice versa? What math goes into combining a more granular x/10 system (one that requires an overall x/10 rating for EACH GAME– bold choice!– while making all other fields optional) for specific elements and a straight-up five star system? To me this seems like factoring in any of the individual element ratings might lend itself to more skewed overall scores (what if someone only rates one or two games on their individual elements? What if one game consistently gets a lot of scoring for specific elements and other games don’t?). I’ve got no horse in this race, and I’m just genuinely curious about how you landed on an overlapping two-site rating scheme and how it’ll address the worries about inequitable scoring.
The Itch rating system is simple on its face. However, beyond the raw data, Itch factors in the number of games and gives different games weight based on the number of votes each receives. Certainly, you wouldn’t want a game that was judged only one time with a perfect score to win the competition.
As the judging period ends, I intend to analyze all of the data and correlate the results to provide the fairest output. It may take several days; I intend to listen to input from the community.
I helped set up the form late last night by making a sample one and sending it in. I ended up hitting the wrong option for that question; there’s a ‘make this mandatory’ slider in the bottom right, should be easy to turn that off.
@jkj_yuio I think your game might still be password protected (it shows up for me like that right now!)
Interesting! Does this mean the scores will be weighted (both sources averaged but those on the form will count for more)? Or does that mean that they’re basically redundant systems, with the form deciding the final score for any games that show significantly differing averages? (Or is there another way that this guarantees fairer rankings that I’m missing because I am, to put it in the mildest way possible, not a math guy?)
) To quote a famous bus conductor, “I hope it’s NOT going to be a bumpy ride.”)
