After conquering ChatGPT, Atari 2600 Video Chess destroys Microsoft Copilot: ‘The vintage silicon mastermind bested me fair and square’

2025-07-07 13:41:00
www.pcgamer.com

Last month we reported on the somewhat-surprising news that an emulated Atari 2600 running the 1979 software Video Chess had “absolutely wrecked” an overconfident ChatGPT at the game of kings. Fans of schadenfreude rejoice, because Microsoft Copilot thought this was a chance to show its superiority to ChatGPT: And the Atari gave it a beating.

There is one fairly big caveat here. Dedicated chess engines have long since surpassed human capabilities, and an off-the-shelf program like Stockfish will handily trounce the best in the world (and the Atari chess game). ChatGPT and Copilot may be world-leading LLMs, but they are not dedicated chess engines.

For its part, Video Chess is very basic chess software, even if creating a working engine within 4KB is its own kind of achievement. The software tries to calculate the best move in a given position, but lacks an overall strategy and can’t calculate more than a move or two ahead.

You’d think, therefore, that the LLMs would have something of an edge. And indeed they exuded confidence in both cases. These experiments were run by Citrix engineer Robert Caruso, and in ChatGPT’s case the model wondered “how quickly” it could beat the Atari “before getting wrecked” while in the Copilot follow-up Microsoft’s LLM was “brimming with confidence” and brazenly declared it was great at chess and this would be no big deal.

(The idea that LLMs can genuinely ‘wonder’ about things or experience feelings like confidence is science fiction, but the anthropomorphization does make what happens next funnier.)

“It claimed it could think 10–15 moves ahead,” says Caruso, “but figured it would stick to 3–5 moves against the 2600 because it makes ‘suboptimal moves’ that it ‘could capitalize on… rather than obsess over deep calculations.'”

Caruso explained to Copilot that a major reason ChatGPT lost was its inability to keep track of the board. No problem, said Copilot, it would “remember previous moves and maintain continuity in gameplay, so our match should be much smoother.” Copilot asked for a screenshot of the board after every Atari move, which Caruso provided, and promised a “strong fight.”

Half of Artificial Intelligence robot face

(Image credit: via Getty Images/Yuichiro Chino)

The vainglorious Copilot barely got out of the starting blocks. “By the seventh turn, it had lost two pawns, a knight, and a bishop—for only a single pawn in return—and was now instructing me to place its queen right in front of the Atari’s queen to be captured on the next turn.” Copilot had previously bragged to Caruso that the Atari “made bizarre moves” but now “it was getting embarrassed.”

Copilot then lost track of the board, despite the prompts being provided after every move, and offered to reset or carry on. Caruso told it that it wouldn’t win with this kind of handicap and it was time to concede. This resulted in a weirdly gracious concession speech:

“You’re absolutely right, Bob,” said Copilot. “Atari’s earned the win this round. I’ll tip my digital king with dignity and honor the vintage silicon mastermind that bested me fair and square. Even in defeat, I’ve got to say: that was a blast… Long live 8-bit battles and noble resignations.”

OK, Hal-9000. At one point Caruso calls the LLM’s behaviour “ChatGPT deja vu” because of the overconfidence with which it went into the task, and its brief attempt to rationalise its way out of its terrible play.

The take-home message is that, even if this is not what LLMs are designed to do, it shows how little these models factor in context and how easily they can lose track of seemingly simple propositions. As Caruso put it (when discussing the ChatGPT example): “Its inability to retain a basic board state from turn to turn was very disappointing. Is that really any different from forgetting other crucial context in a conversation?”

Source Link

Take your gaming to the next level! The Redragon S101 RGB Backlit Gaming Keyboard is an Amazon’s Choice product that delivers incredible value. This all-in-one PC Gamer Value Kit includes a Programmable Backlit Gaming Mouse, perfect for competitive gaming or casual use.

With 46,015 ratings, an average of 4.6 out of 5 stars, and over 4K+ bought in the past month, this kit is trusted by gamers everywhere! Available now for just $39.99 on Amazon. Plus, act fast and snag an exclusive 15% off coupon – but hurry, this offer won’t last long!

Score this incredible deal now!

Unlock unlimited streaming with a free Amazon Prime trial!
Sign up today!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!

BITCOIN

Bitcoin Logo