Trail of Bits releases patching-bugs and regression-hunt plugins, letting agents fix vulnerabilities and investigate regressions
Your AI agent fixed the bug, but what else did it change?
Trail of Bits released two plugins, patching-bugs and regression-hunt, letting engineers hand patch development and regression checks to agents. The two plugins stem from its Patch the Planet program in collaboration with OpenAI, and their design is based on a retrospective of 130-plus merged PRs (confirming 21 regressions, of which 16 were functional, 1 performance, and 4 build/test, none of which broke safety guardrails) and analysis of thousands of engineer Codex sessions. In preliminary evaluation, regression-hunt produced 25% fewer false-positive findings than a baseline Codex agent prompted to "review PRs for regressions" (95% confidence interval 14%–38%), at the cost that some known regressions could only be marked as pending due to insufficient evidence. patching-bugs emphasizes three-arm verification (original code fails, passes after patching, fails again after full rollback) and fixes based on safety invariants, and mandates running regression-hunt.
The author bases this on a regression retrospective and comparative evaluation of their own 130-plus merged patches; maintainers can borrow this standardized patch and regression check process.