ParserComp 2025 - Initial Results

I am inclined to disagree with this assessment. I don’t at all blame you or fos1 for making your decision to accept the games based on the information the authors provided to you:

But that information turned out to be demonstrably and flagrantly false. It’s in the games themselves (see pinkunz’s screenshots)-- they say they were made with AI as a “parser/translator” but are pinging a server live and generating gobs of text-book AI writing. That’s not your fault, that’s mischaracterization on the authors’ part.

I do think that, upon realizing this misrepresentation, the games should have been disqualified afterward without fears of reneging on a previous decision or somesuch, especially since it was made on (unbeknownst to you) false premises. But the original decision is not something to feel bad about, imo.

24 Likes