Anthropic uses Claude to formally verify safety properties of over a hundred open-source libraries within a few weeks
Anthropic published new research on the Frontier Red Team blog, working with Theorem Labs to use Claude to prove safety properties for over a hundred real open-source libraries within a few weeks. Formal verification can prove that code does not contain specific classes of bugs, but in the past it was only feasible for small codebases or required substantial expert time; Anthropic says that with the emergence of AI models, this situation is beginning to change. Logan Graham says the team direction this work foreshadows is to first find and fix all bugs, and then rewrite the foundations of software so that it contains no bugs from the start. The full research is at https://www.anthropic.com/research/formal-verification
step 1: find and fix all the bugs
step 2: rewrite the foundations of software to not have bugs in the first place
Proud of this work from @keenlooks and @theoremlabs and team. This is a glimpse of the direction we're going.
New on our Frontier Red Team blog: using Claude to formally verify software at large scale.
Formal verification can prove that code is free of certain bugs, but historically it has only been feasible for small codebases (or required a lot of expert time).
With AI models, however, this is beginning to change. In collaboration with @theoremlabs, we used Claude to prove security properties in over one hundred real-world open-source libraries over the span of a few weeks.
Read our research in full here: https://www.anthropic.com/research/formal-verificationView the quoted post on X