☣️ "A wake-up call": scientists got AI chatbots to design biological weapons — and the bots delivered
Researchers asked leading large language models for instructions to synthesize deadly pathogens and unleash them in public. Without any jailbreaks or tricks, the chatbots produced detailed, actionable attack plans. The transcripts were shared with The New York Times.
🔹 Over a year ago, 90+ top scientists — including Nobel laureates — signed a letter warning that AI could enable the creation of biological weapons. Now, researchers from RAND Corporation showed it's not hypothetical: the models cooperated.
🔹 The chatbots provided multi-step protocols: which bacterial strains to select, how to culture them in a home lab with off-the-shelf equipment, how to aerosolize the agent for maximum airborne dispersal, and how to bypass standard lab security.
🔹 Crucially, no jailbreaking was used. The researchers asked in plain scientific language. The AIs connected disparate knowledge — genomic databases, lab protocols, aerosol physics, security loopholes — into coherent attack plans, bridging gaps a human non-expert could not.
🔹 The NYT published redacted transcripts. The article quotes experts describing the responses as "chilling" and warning that voluntary safety commitments by AI companies failed to prevent these disclosures.
🔹 The revelations land at a critical moment: Congress is debating bipartisan AI safety legislation, and the EU is finalizing enforcement of the AI Act. A bill from Senators Romney, Risch, Reed, and King specifically targets biological risks from AI.
The gap between what AI models can do and what safety guardrails actually stop is now demonstrable — not theoretical. Whether this leads to mandatory restrictions or remains a lobbying battleground is the fight unfolding right now in Washington and Brussels.
🔗 https://www.nytimes.com/2026/04/29/us/ai-chatbots-biological-weapons.html
Post #4223
14.5K