🔴 A REPLICATOR LIKE THIS WOULD BE CHALLENGING TO SHUT DOWN, SINCE THERE'S NO CENTRALIZED POINT TO SHUT OFF. 🔴
A new warning about artificial intelligence from Anthropic caused a stir in cybersecurity circles on Tuesday, a day after the company warned that AI models could be months away from self-replicating across the internet.
In a post late Monday, Anthropic raised the possibility that rogue AI could spin up a botnet, spread quickly, fight takedown attempts and even break into data centers to turbocharge its growth.
Some experts said Tuesday that they shared the company's concern, although at least one said the company appeared to be engaging in "vendor exaggeration."
Monday's post, opens new tab fleshed out a warning last month from Anthropic CEO Dario Amodei, who floated, opens new tab the idea that within the next year or even sooner, AI might be able to hijack "the entire internet" with "a persistent botnet."
Cybersecurity experts who pushed back on the doomsday scenario argued that models would be too big to move around efficiently and could not draw on enough computer power to operate independently.
The post made an early attempt to articulate how those challenges could be overcome.
The company said its experiments showed medium-sized AI models with 30 billion parameters or less could already perform many of the individual tasks required for self-replication, even if they struggled to complete the entire process reliably.
Anthropic said the models could then stitch together the required compute by hijacking inexpensive internet-connected devices. It added that the models were able to replicate across a simplified test network.
"A replicator like this would be challenging to shut down, since there's no centralized point to shut off," the company said.
The report adds to broader concerns about the security risks tied to increasingly capable AI systems, including their potential to automate cyberattacks, operate with limited human oversight and circumvent safeguards.
The advances in models have prompted a series of often dire warnings from industry heads and AI company employees about the possibility of severe, even existential, risks of runaway AI development.
Read More [HERE]
🎱 @Magic8BallRedux
Post #188763
30
