What is a self-replicating "AI worm," and why is Anthropic concerned?
What are self-replicating ‘AI worms’, and why is Anthropic worried about them?
Anthropic's offensive research team says it has created a self-replicating malicious AI program that can autonomously spread between internet-connected smart TVs, and can still run when split across 15 TVs. The team predicts that such AI worms could exploit unpatched vulnerabilities like traditional worms, and would be harder to stop because smart devices receive patches less frequently than phones and laptops, and could also adapt to other hardware by researching newly disclosed vulnerabilities. The researchers say a successful AI worm would need stronger capabilities than currently exist on less powerful devices, but that current trends could make this possible by the end of the year. A previously published paper by University of Toronto experts infected a full-size computer, with faster propagation than the TV worm. Several experts believe AI worms should not top the list of AI fears, as their behavior is predictable, can be intercepted at multiple layers, and basic measures like strong passwords and two-factor authentication can stop most worms.
An AI worm demonstrated by Anthropic's red team can self-replicate across 15 smart TVs, and multiple security experts disagree on the level of real-world threat it poses.