Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You're too kind. Even the CEO of Google retweeted how well Gemini 2.5 did on Pokemon. There is a high chance that now it's explicitly part of the training regime. We kind of need a different kind of game to know how well it generalizes.


I have a draft doing this with text adventures: https://entropicthoughts.com/updated-llm-benchmark




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: