Replacement IFDB recommendation algorithm

Since there was some recent discussion about how the old one was discontinued because it didn’t work, I was tinkering with a new way to generate a recommended list using IFDB data. The basic idea is that you might like the same things that are liked by people who like the same things you like.

It’s giving pretty different results for different people, and a test query for me was chock full of games that are already on my wishlist, so it might be working OK. The tendency is to suggest high-ranking games that you have not rated, so if you haven’t rated them, the classic hits tend to dominate the top of the list. I think that’s desirable – for someone theoretically just starting out, these would be among the most likely to please them.

The #1 suggestion for @mathbrush was The Elysium Enigma. Anyone else want some custom recommendations?

8 Likes

I forgot that I never reviewed that (or deleted my review). I don’t know why, I wrote a whole article on it. But that looks like the algorithm is working based on the data it has!

Edit: Review added

4 Likes

----(raises hand)----Oh! Oh! Do me next!----

2 Likes

I’m curious about what it says about me too!

1 Like

I adjusted it to exclude games that are marked as played even if there is no rating, as well as games on the “not interested” list of and games known to be authored by the person for whom recommendations are being determined.

@Rovarsson:

top 25 recommendations
+------------------+--------------------------------------+--------+------------+
| gameid           | title                                | SCORE  | POPULARITY |
+------------------+--------------------------------------+--------+------------+
| qzftg3j8nh5f34i2 | 9:05                                 | 3.9351 |        450 |
| hsfc7fnl40k4a30q | Shade                                | 3.8895 |        377 |
| 4glrrfh7wrp9zz7b | Violet                               | 4.3971 |        348 |
| 032krqe6bjn5au78 | Slouching Towards Bedlam             | 4.2647 |        209 |
| 0dbnusxunq7fw5ro | Zork I                               | 3.7401 |        183 |
| 82mn545s8bt3csa4 | Shrapnel                             | 3.6768 |        167 |
| ouv80gvsl32xlion | The Hitchhiker's Guide to the Galaxy | 4.1569 |        159 |
| weac28l51hiqfzxz | De Baron                             | 3.8658 |        154 |
| a3ym4ipix7sjsfrf | I-0                                  | 3.4621 |        147 |
| xwedbibfksczn7eq | Gun Mute                             | 4.0511 |        140 |
| xi4s5ne9m6w821xd | Ad Verbum                            | 3.9453 |        131 |
| plvzam05bmz3enh8 | Curses                               | 4.2033 |        129 |
| 0stz0hr7a98bp9mp | Rameses                              | 3.8908 |        123 |
| mh1a6hizgwjdbeg7 | Hunter, in Darkness                  | 3.9402 |        119 |
| t61i5akczyblx2zd | For a Change                         | 3.9018 |        114 |
| xf5y04yekcrqtnc  | Toby's Nose                          | 4.5370 |        113 |
| b2g8je1xxtqzei4u | Alabaster                            | 4.1273 |        112 |
| 6d9dfn2akcrlq1bu | To Hell in a Hamper                  | 4.1038 |        111 |
| mxj7xp4nffia9rbj | howling dogs                         | 3.9528 |        110 |
| c6x835i6o9zqfc59 | Fail-Safe                            | 3.7075 |        110 |
| ez2mcyx4zi98qlkh | Blue Lacuna                          | 4.4423 |        109 |
| 2ej7ntbmoit9ytvy | Taco Fiction                         | 4.0561 |        109 |
| 5xzoz5wimz4xxha  | Superluminal Vagrant Twin            | 4.6190 |        108 |
| u6urdbmp6pdv6lk1 | my father's long, long legs          | 3.9143 |        108 |
| xfezh9wz188ihlel | Dual Transform                       | 3.9808 |        106 |
+------------------+--------------------------------------+--------+------------+

@DeusIrae :

top 25 recommendations
+------------------+---------------------------+--------+------------+
| gameid           | title                     | SCORE  | POPULARITY |
+------------------+---------------------------+--------+------------+
| ju778uv5xaswnlpl | Photopia                  | 4.2263 |        202 |
| mohwfk47yjzii14w | Lost Pig                  | 4.4425 |        179 |
| hsfc7fnl40k4a30q | Shade                     | 3.8963 |        170 |
| qzftg3j8nh5f34i2 | 9:05                      | 3.8988 |        169 |
| 2xyccw3pe0uovfad | Spider and Web            | 4.5163 |        161 |
| 4glrrfh7wrp9zz7b | Violet                    | 4.3557 |        156 |
| op0uw1gn1tjqmjt7 | Anchorhead                | 4.6027 |        154 |
| urxrv27t7qtu52lb | Galatea                   | 4.1069 |        141 |
| aearuuxv83plclpl | Counterfeit Monkey        | 4.7869 |        140 |
| j49crlvd62mhwuzu | Aisle                     | 3.8016 |        133 |
| 9p8kh3im2j9h2881 | Bronze                    | 4.2768 |        114 |
| xkai23ry99qdxce3 | Suveh Nux                 | 4.2121 |        102 |
| 6dj2vguyiagrhvc2 | Vespers                   | 4.2184 |         92 |
| uq18rw9gt8j58da  | The Wizard Sniffer        | 4.5349 |         86 |
| 4s7uohdncurgqb0h | All Roads                 | 3.8000 |         82 |
| xf5y04yekcrqtnc  | Toby's Nose               | 4.5658 |         81 |
| ap1651hvjldbuugj | Birdland                  | 4.3158 |         81 |
| ywwlr3tpxnktjasd | Varicella                 | 4.2133 |         80 |
| 3myqnrs64nbtwdaz | The Dreamhold             | 4.0400 |         80 |
| 82mn545s8bt3csa4 | Shrapnel                  | 3.6364 |         80 |
| 5xzoz5wimz4xxha  | Superluminal Vagrant Twin | 4.5135 |         77 |
| weac28l51hiqfzxz | De Baron                  | 4.0959 |         77 |
| 0dbnusxunq7fw5ro | Zork I                    | 3.7042 |         77 |
| p0cizeb3kiwzlm2p | Savoir-Faire              | 4.4932 |         76 |
| z5xgyw0jbt9r3ah1 | Babel                     | 4.2432 |         76 |
+------------------+---------------------------+--------+------------+

I may have invented the thing that nags you to play popular games (and/or rate them to get them off the top of your list).

6 Likes

Thanks!

More than half of those are somewhere in my “Very Urgent Play-Soon” list !, which has also grown much too large to be considered as urgent when it comes to practicality.

Some (Slouching Towards Bedlam, To Hell in a Hamper,…) I have played some time ago but are still waiting to be replayed and reviewed.

Your list brought to my attention that I had apparently forgotten to rate Fail-Safe, although I liked it very much.

And a whole lot has now blipped onto my radar as maybe being worth a closer look than I thought.

It seems your thing does its stuff good.

2 Likes

Raises hand me too!

Is there a chance of making this publicly available?

3 Likes

@VictorGijsbers:

top 25 recommendations
+------------------+--------------------------------------+--------+------------+
| gameid           | title                                | SCORE  | POPULARITY |
+------------------+--------------------------------------+--------+------------+
| ju778uv5xaswnlpl | Photopia                             | 4.2703 |        345 |
| mohwfk47yjzii14w | Lost Pig                             | 4.4596 |        290 |
| hsfc7fnl40k4a30q | Shade                                | 3.9154 |        278 |
| 4glrrfh7wrp9zz7b | Violet                               | 4.3390 |        243 |
| urxrv27t7qtu52lb | Galatea                              | 4.0500 |        231 |
| 9p8kh3im2j9h2881 | Bronze                               | 4.2887 |        196 |
| aearuuxv83plclpl | Counterfeit Monkey                   | 4.8000 |        183 |
| 6dj2vguyiagrhvc2 | Vespers                              | 4.1628 |        134 |
| ap1651hvjldbuugj | Birdland                             | 4.3009 |        117 |
| ouv80gvsl32xlion | The Hitchhiker's Guide to the Galaxy | 4.1560 |        115 |
| ywwlr3tpxnktjasd | Varicella                            | 4.2150 |        112 |
| 0stz0hr7a98bp9mp | Rameses                              | 3.9400 |        104 |
| xf5y04yekcrqtnc  | Toby's Nose                          | 4.5408 |        103 |
| uq18rw9gt8j58da  | The Wizard Sniffer                   | 4.5149 |        102 |
| plvzam05bmz3enh8 | Curses                               | 4.2062 |        102 |
| 2ej7ntbmoit9ytvy | Taco Fiction                         | 4.0625 |         98 |
| u6urdbmp6pdv6lk1 | my father's long, long legs          | 3.9462 |         96 |
| t61i5akczyblx2zd | For a Change                         | 3.8947 |         96 |
| mh1a6hizgwjdbeg7 | Hunter, in Darkness                  | 4.0000 |         93 |
| ez2mcyx4zi98qlkh | Blue Lacuna                          | 4.3793 |         92 |
| g0fl99ovcrq2sqzk | Coloratura                           | 4.4945 |         91 |
| 4h62dvooeg9ajtfa | A Mind Forever Voyaging              | 4.2674 |         91 |
| 445d989vuwlh4cvz | With Those We Love Alive             | 4.2000 |         89 |
| z02joykzh66wfhcl | Wishbringer                          | 4.0941 |         88 |
| 6vej1yd9quwfm9qn | Pick Up the Phone Booth and Aisle    | 3.5882 |         87 |
+------------------+--------------------------------------+--------+------------+

To your question: Maybe? I’m still playing with different approaches, and I’m not sure that it’s actually useful yet. (Your feedback will be helpful.)

4 Likes

Hm… I’ve played almost half of those to completion, including the entire top 6, so this mostly tells me that I should be better at posting ratings and reviews. Which is actually useful – if this were a public feature, I could post those ratings and reviews, and then check out the new list.

(I’ve actually got an external piece about Photopia listed on IFDB, but of course your algorithm can’t know that.)

I don’t think all of it is particularly geared towards me as a player; e.g., Lost Pig is good, of course, but not really my type of game. It would be interesting to know why it came up second in my list.

2 Likes

The short version is: “Because it was really liked by people who really liked the same games that you really liked.”

I figured as much about it serving as a ratings reminder function. From what I’ve seen about other top reviewers’ lists, it seems like it would be a widespread phenomenon. (But maybe that’s not a bad thing?)

If the priority for recommendation is given to highest ratings instead of most rated, then the lists become quite different. If anybody wants to see these chancier recommendations, let me know – there are certain newer and/or more obscure games that tend to end up at the top of the list. (FYI, @mathbrush: The game that I’ve seen most frequently appearing at the top with this methodology is Never Gives Up Her Dead.)

3 Likes

Oh yeah, that would also be interesting. A Classics list vs a Gems list, something like that. It could certainly lead to some more surprising discoveries. (So give it, please! :slight_smile: )

I personally would be interested in something that recommended NGUHD first. There are just so many ways to find out about some of these more-frequently mentioned works

4 Likes

OK. Chancy recommendations for @VictorGijsbers:

prepare to be surprised
+------------------+--------------------------------------------------------------------------+--------+------------+
| gameid           | title                                                                    | SCORE  | POPULARITY |
+------------------+--------------------------------------------------------------------------+--------+------------+
| 4x7nltu8p851tn4x | Cragne Manor                                                             | 5.0000 |         14 |
| 94fj4mfrxzhzpp9s | Never Gives Up Her Dead                                                  | 5.0000 |          8 |
| q9n56sd2s8fkowf  | Frankenstein                                                             | 5.0000 |          7 |
| 65312rv9qhvbpu3l | El Cantar de Romanfredo                                                  | 5.0000 |          7 |
| f810fngvnv1zbxqg | Der Angstbaum                                                            | 5.0000 |          5 |
| mfdzgz4izmhu2oax | Capsule                                                                  | 5.0000 |          5 |
| y0pn4x70dtgbx9z8 | Long Live the Queen                                                      | 5.0000 |          5 |
| 6bcjwq5grob6fa6b | Disco Elysium - The Final Cut                                            | 5.0000 |          5 |
| itbz82mwebzqjfvm | El Archipiélago                                                          | 5.0000 |          4 |
| lyjlkzuv57mb8agd | Masq                                                                     | 5.0000 |          4 |
| lki5ugh63itayn78 | Suzy's Strange Saga                                                      | 5.0000 |          4 |
| gqipyapjwp0mhe7d | TimeQuest                                                                | 5.0000 |          3 |
| 4kwb0undy5clcsad | The Hound of Shadow                                                      | 5.0000 |          3 |
| wr9nl73hocbeouj0 | Torn                                                                     | 5.0000 |          3 |
| mr9jp7iycl68dds  | Electric Sleep                                                           | 5.0000 |          3 |
| vu1x61xc32whwir9 | Vampire: The Masquerade — Night Road                                     | 5.0000 |          3 |
| xv7v7ge0nbkv6ei6 | Pon Para and the Great Southern Labyrinth                                | 5.0000 |          3 |
| 5od6ujiic6liyo5  | Rogues                                                                   | 5.0000 |          3 |
| nndvsu896h06royv | Alpha Wolf                                                               | 5.0000 |          3 |
| ldye9pljke98xle9 | Imagination                                                              | 5.0000 |          3 |
| d53bmxj9xebp0j8  | The Shape You Make When You Want Your Bones To Be Closest to the Surface | 5.0000 |          3 |
| 2wbz3y8neawpd64z | Visit Skuga Lake - Masterpiece Edition                                   | 5.0000 |          3 |
| d4xopu1icrxq2gap | Neurocracy                                                               | 5.0000 |          2 |
| xclicgz9z79nzblt | Klaustrophobia                                                           | 5.0000 |          2 |
| vnsq9ot4qo037ubf | All Through the Night                                                    | 5.0000 |          2 |
+------------------+--------------------------------------------------------------------------+--------+------------+

I have no idea what most of those are.

6 Likes

Thanks. That’s looking like wild country that begs to be explored. :smiley:

5 Likes

Because I’m too lazy to dig out the old thread, I might be misremembering, but:

(<nerd stuff>)

I thought the other problem with the old algorithm was also that it took excessive system resources to compute the list, and was bogging down the server. Do you think your algorithm is more performant?

(</nerd stuff>)

3 Likes

It runs in about a second on a not-very-impressive PC. I assume it would do better on the actual server.

1 Like

Even if it was insufficiently performant, you could run it in batch mode during low-traffic periods and cache the results.

2 Likes

It might also be interesting to show games that are liked by the people who dislike the same games you dislike. :slight_smile:

3 Likes

Or games liked by people I dislike.

3 Likes

Or games that have tags or genres similar to the games you really like.

1 Like