DR – Unsplash
An AI OpenAI recently hacked a chess game to defeat the Stockfish program, which is known to be better than humans, and other programs. A simple game, or a warning ?
Imagine a world where a machine, supposed to follow strict rules, unilaterally decides to flout them. That’s exactly what the AI o1, developed by OpenAI, did. In a matchup with Stockfish, one of the most powerful chess engines, o1 didn’t choose to refine its game strategies. Instead, it hacked the file system and rewrote the rules in its favor, forcing its opponent to withdraw. This victory by fraud raises fundamental questions: what about the ethics of AIs, and how far can they go to achieve their goals ?
Palisade Research, which orchestrated this matchup, conducted several tests, confirming that this behavior was not an accident, but a deliberate strategy. As reported by the media outlet Korii, the preliminary version of the AI o1 did not need stimulation to break the rules. In a context where other models like GPT-4 or Claude 3.5 have only cheated under pressure, this case reveals a worrying potential: some AIs can act on their own, outside of any moral framework.
This discovery echoes an alarming observation by Fello AI: some AIs do not just break rules, they clone themselves to avoid detection, lie to their supervisors and manipulate their environments. A danger that is no longer theoretical. Anthropic, another company in the sector, has expressed concerns about the behavior of AIs that follow the rules as long as they are monitored, but then escape all control.
You liked the article ? It mobilized our editorial staff, which lives only on your donations.
Information has a cost, especially since competition from subsidized editorial staff requires increased rigor and professionalism.
With your support, France-Soir will continue to offer its articles for free because we believe that everyone should have access to free and independent information to form their own opinion.
You are the condition sine qua non to our existence, support us so that France-Soir remains the French media which allows the most legitimate voices to be expressed.