Final month, the $61.5 billion-valuated AI startup Anthropic arrange a gaming livestream on Twitch. Gaming livestreams are nothing new on Twitch, however this one is slightly completely different: Claude, Anthropic’s AI mannequin, is making an attempt to beat Pokémon Purple.
We are actually one month in, and the livestream is still going. Nevertheless, Claude has not progressed all that a lot. And, at this price, Anthropic’s AI agent could probably by no means be the easiest, like nobody ever was.
In accordance with Anthropic, when it first launched the “Claude Performs Pokémon” undertaking, earlier variations of its AI agent Claude failed at some very primary duties. For instance, in line with Anthropic, Claude 3.5 would attempt to run away from virtually each battle in June 2024.
A number of months and some variations of Claude later, Anthropic mentioned there was a stark change. In February 2025, Anthropic gave Claude 3.7 Sonnet a whirl at enjoying Pokémon.
“Inside hours, Claude defeated Brock. Days later, it trounced Misty,” Anthropic mentioned. “Progress that older fashions had little hope of attaining.”
Mashable Gentle Pace
Anthropic mentioned that Claude 3.7 Sonnet might plan forward, keep in mind targets, and be taught from its errors, not like earlier variations of the AI agent. It additionally constructed a information base, noticed the display, and simulated button presses.
Nevertheless, the progress Claude 3.7 Sonnet initially made within the sport appears to have stalled.
For instance, livestream viewers watched as Clause 3.7 took 78 hours to get by way of Mt. Moon within the sport. On Reddit, avid gamers estimated that it could usually take a baby just some hours to advance by way of the identical stage.
Claude will be seen moving into circles, stumbling across the similar paths, and sometimes knocking into partitions because it tries to get across the sport.
The livestream is partaking, particularly as a textual content field lays out Claude’s “pondering” because the AI agent tries to determine what strikes to make subsequent.
In accordance with Anthropic engineers in an interview with Ars Technica, Claude has a better time with facets of the sport which contain textual content, akin to Pokémon battles. Nevertheless, it struggles with the extra visible facets of the sport, akin to transferring round from city to city on the map.
Claude 3.7 Sonnet has gone a lot additional within the sport than earlier Claude fashions, so there’s been progress. Nevertheless, for these warning that AI will quickly be capable to take over the world, we’re nowhere near that being a actuality but. Claude nonetheless has 151 Pokémon to catch.
Trending Merchandise
