This data and the Itch rating system will be used to rank the games. As the ratings become available, I intend to make the process as equitable as possible. I will post the data and the ranking algorithms. I intend to make frequent backup copies of the spreadsheet to help with data validation and security. (I’m a little gun-shy about the rating system. ) To quote a famous bus conductor, “I hope it’s NOT going to be a bumpy ride.”)
This might be off topic, but I’ve been lurking in the discussions about scoring schemes and am curious about this proposed two-track rating scheme. How will this work? What if there are more people rating on itch than on the form (seems very likely), or vice versa? What math goes into combining a more granular x/10 system (one that requires an overall x/10 rating for EACH GAME– bold choice!– while making all other fields optional) for specific elements and a straight-up five star system? To me this seems like factoring in any of the individual element ratings might lend itself to more skewed overall scores (what if someone only rates one or two games on their individual elements? What if one game consistently gets a lot of scoring for specific elements and other games don’t?). I’ve got no horse in this race, and I’m just genuinely curious about how you landed on an overlapping two-site rating scheme and how it’ll address the worries about inequitable scoring.
The Itch rating system is simple on its face. However, beyond the raw data, Itch factors in the number of games and gives different games weight based on the number of votes each receives. Certainly, you wouldn’t want a game that was judged only one time with a perfect score to win the competition.
As the judging period ends, I intend to analyze all of the data and correlate the results to provide the fairest output. It may take several days; I intend to listen to input from the community.
I helped set up the form late last night by making a sample one and sending it in. I ended up hitting the wrong option for that question; there’s a ‘make this mandatory’ slider in the bottom right, should be easy to turn that off.
@jkj_yuio I think your game might still be password protected (it shows up for me like that right now!)
Interesting! Does this mean the scores will be weighted (both sources averaged but those on the form will count for more)? Or does that mean that they’re basically redundant systems, with the form deciding the final score for any games that show significantly differing averages? (Or is there another way that this guarantees fairer rankings that I’m missing because I am, to put it in the mildest way possible, not a math guy?)
Hi! A couple clarifying questions about the rating form.
The form asks:
What is your name/username you want to be identified by?*
Could you confirm that this identification is being used solely for the comp organizer’s internal verification of votes (in other words, to prevent cheating)? Will votes will be kept anonymous, i.e. not shared publicly or tied to our names/usernames? The wording of this form prompt leaves this open to interpretation.
Also, to clarify: We should be using either the Google form oritch.io to submit our votes (and preferably the Google form), and not rating on both platforms. Is that correct?
Your username here in IntFiction would be fine. I am using it as a cross-check.
No personal information, either the username or the email, will be shared with anyone. I am the only one who will see the ratings sheets. The game rating data will be tabulated, but not any personal data. (If someone would like to see the rating sheets, any personal information will be redacted before release.)
Either or both rating systems will work. After all ratings are in and tabulated, I intend to release as much detail as possible to validate the outcome.
) To quote a famous bus conductor, “I hope it’s NOT going to be a bumpy ride.”)
