Connect with us

Hi, what are you looking for?

SecurityWeekSecurityWeek

Artificial Intelligence

Small AI Models May Soon Be Able to Self-Replicate on IoT Devices, Anthropic Warns

Experiments show cheap TV boxes can run capable AI models, and small models may soon be able to spread across such devices on their own.

Botnet

Small AI models may be only months away from being able to self-replicate across commercial IoT devices, without needing a data center, according to research from Anthropic’s Frontier Red Team.

The study looks at AI worms that run their own model directly on the devices they compromise. Such malware would be hard to shut down because it has no central point to switch off, though it would likely spread slowly.

The researchers bought 15 off-brand Android-based TV boxes for about $55 each. A 26-billion-parameter open-weight model split across them ran at 0.39 tokens per second.

Rather than exploitation, which prior studies have already examined, the team focused on whether models could get AI inference running on unfamiliar hardware. A 9-billion-parameter model did so on eight of the nine hardware types tested.

The researchers then tested the full replication cycle on a closed network of eight emulated Android devices, with the hacking step deliberately kept trivial. Of the open-weight models tested, only GLM-5.2 completed it, reaching all eight devices in four of five runs.

Anthropic considers the results an upper bound for real-world success, but notes that past IoT botnets such as Mirai spread simply by trying default manufacturer credentials.

Advertisement. Scroll to continue reading.

Models with 30 billion parameters or fewer can already complete many of the individual steps but make mistakes when chaining them together. If they keep improving at their historical rate, Anthropic expects them to reach GLM-5.2’s level by the end of 2026.

“Small weight-based replicators may be possible soon after,” the company says.

Anthropic also looked at a botnet as large as Kimwolf, which infected more than two million devices. If every 15 TV boxes ran one copy of the 26-billion-parameter model, such a botnet would host roughly 133,000 copies. Their combined compute would be worth at most about 40 Nvidia H100 GPUs, and each replication would take more than a day.

[ Read: AI Turns Familiar Cyberattacks Into a Race Against Time ]

Unlike traditional botnets built for specific devices, an AI worm could work out unfamiliar hardware on its own, Anthropic says. Defenders, however, still have some advantages.

Large model transfers and sustained traffic between devices that don’t normally communicate would stand out in ISP monitoring. In addition, moving manufacturers to more secure defaults, such as eliminating default passwords, would also shrink the target pool.

There is no full rogue replicator yet, Anthropic says, but models are getting better at each step in the chain and at passing what they learn on to their copies.

Related: OpenAI Fires 3 Safety Researchers in Dispute Over AI Risks

Related: Anthropic Fast-Tracks AI Bug Reports to OSS Maintainers, Taps 11 Firms for OT Security

Related: Formula Predicts When AI Chatbots Are at Risk of Turning Bad

Written By

Eduard Kovacs (@EduardKovacs) is senior managing editor at SecurityWeek. He worked as a high school IT teacher before starting a career in journalism in 2011. Eduard holds a bachelor’s degree in industrial informatics and a master’s degree in computer techniques applied in electrical engineering.

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing for the latest cybersecurity threats, trends, and expert insights.

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing to stay informed on the latest threats, trends, and technology, along with insightful columns from industry experts.

Learn about Frontier Pace Governance: a practical approach to helping IT operations move at AI speed without sacrificing security, accountability, or operational discipline.

Register

Join as we decipher the world of zero trust and share war stories on securing an organization by eliminating implicit trust and continuously validating every stage of a digital interaction.

Register

People on the Move

Rapid7 has named Rik Ferguson as VP of Security Intelligence.

Cytactic has appointed Tim Brown as CSO.

Scott Simkin has joined Vega as CMO.

More People On The Move

Expert Insights

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing to stay informed on the latest cybersecurity news, threats, and expert insights. Unsubscribe at any time.