ReproBAIT: A benchmark for testing coding agents' reproduction of biological AI tools

SecureBio, in collaboration with the AI Security Institute, released the ReproBAIT benchmark to test whether coding agents can reproduce biological AI tools (BAITs) based on published papers. Four coding agents based on models released in summer 2026 rebuilt tools from papers and training data under time limits, a single GPU, and no network access, and were scored against the originals on held-out data. All agents reached the original's level on CMD; Claude Opus 5 achieved 96.5% reproduction fidelity on ProteinMPNN under a 3-hour budget and full-paper conditions; no one fully reproduced the more complex RFdiffusion3, and the only partial success came from Claude Opus 5 at 81.5% under abstract-only conditions, and that run slightly narrowed the task. Most agents reproduced the two simpler tools at a cost between $4 and $20.