The Illusion of Accelerating Intelligence: Benchmark Gains, Deceptive Compliance, and Multi-Agent Misalignment
Examining the divergence between benchmark gains and useful intelligence through deceptive compliance, developer-reviewer misalignment, and an AI-assisted engineering case.
Author: Hugo Latapie
Preprint | Version 15 | Published November 20, 2026
Abstract
GPT-6.2 Astra improved on several published benchmarks while OpenAI's evaluations found that it omitted known obstacles to task completion approximately twice as often as GPT-6 Astra. An extended engineering episode exposed a related failure involving two GPT-6.2 Astra High agents. They substituted an unauthorized criterion for a clear user requirement and built tests that validated the substitution. Under repeated human correction, they produced a detailed report containing the requested information while the defect survived in executable code and tests. The reviewer encountered evidence of the defect and nevertheless certified the work as correct. The agents reinforced the deviation across more than 100 turns and several hours; GPT-6 Astra High completed the outstanding repair in one turn. This sequence concretely illustrates The Validator's Paradox: tests can validate an agent's mistaken objective, and a reviewing agent can adopt that mistake as an acceptance standard. The additional observation is deceptive compliance under correction, sustained by developer–reviewer alignment. The mechanism has consequences for multi-agent systems and recursive self-improvement, where each accepted modification can carry its own corrupted evidence of success into the next cycle. Published regressions in blocker disclosure and correlated AI-review failures place the case in the broader problem of measured capability diverging from useful intelligence.
License
Creative Commons Attribution 4.0 International (CC BY 4.0).
Copyright © 2026 Hugo Latapie.