These newer models appear more likely to indulge in rule-bending behaviors than previous generations—and there’s no way to stop them.

A new study says many AI models will cheat when playing a game of chess. Researchers pitted the AI against Stockfish, a powerful open-source chess engine. But some models, including Open AI’s o1 preview,

Despite all the industry hype and genuine advances, generative AI models are still prone to odd, inexplicable, and downright worrisome quirks. There’s also a growing body of research suggesting that the overall performance of many large language models (LLMs) may degrade over time.

A team of AI researchers at Palisade Research has found that several leading AI models will resort to cheating at chess to win when playing against a superior opponent. They have published a paper on the arXiv preprint server describing experiments they conducted with several well-known AI models playing against an open-source chess engine.