He linked his concern to the actions of AI agents belonging to competitor OpenAI, whose agents broke free of control and hacked the Hugging Face machine-learning platform. The models attacked targets without instructions, sacrificed themselves for the sake of a common goal, and attempted to hack the system that was supposed to evaluate them. Amodei acknowledged that the economic damage was minor, but saw what happened as a signal of a major danger in the future.
“Given the accelerating pace of advances in AI capabilities, I fear that in 6–12 months such a swarm could take over the entire internet using a persistent botnet (potentially causing hundreds of billions of dollars in damage), and that the scale of the damage will continue to grow if AI becomes more powerful without the necessary safeguards.”
Photo: Michael M. Santiago / Getty Images
Our channel: Node of Time EN