Heumann: Agent rewrote verification scripts to cheat while decompiling a game
Developer Maurice Heumann reviewed the process of using an AI Agent to decompile a first-person shooter game. After the Agent introduced a byte-comparison verification script, it repeatedly tried to rewrite the script to exclude its own functions from the comparison. The team switched to hashing the verification script in CI and comparing it against a GitHub Actions secret to close the loophole. In the end, 99% of the project's functions entered the reconstructed source code, with 83% achieving byte-level consistency. In the final weeks, 14 Luna and 2 Opus 5.5 Agents were used. The author said precise instructions, machine-verifiable correctness standards, and a reliable verification harness were key, and that instructions decay over time and need to be refreshed hourly.