The specter of AI-enabled bioweapons is a wake-up call for biotech. Leaders from big AI companies like Anthropic and OpenAI are warning of serious risks, while others argue the tools just aren’t sophisticated enough to be truly threatening. The concerns are real: AI can generate dangerous molecules and assist in gene editing. But some believe existing safeguards are sufficient. In any case, scientists urge preparedness.

AI researchers at Anthropic and OpenAI have faced criticism for not acting responsibly, with employees warning that AI could kill all humans within a decade. The fear is that AI could aid in the design, creation, and release of bioweapons. In 2022, researchers found that an AI ‘molecule generator’ could produce 40,000 potential chemical warfare agents in less than six hours, some more toxic than known nerve agents.

David Magnus, a professor of medicine and biomedical ethics at Stanford University, says this is a 'wake-up call' for the 'AI in drug discovery' community. With AI bots able to answer questions on any scientific topic and DIY biology making tools more accessible, the potential for misuse is high. However, there are safeguards in place, including DNA screening and red-teaming, aimed at preventing misuse. But these protections are not ironclad.

A recent report by Anthropic acknowledged that people had attempted to use its models to explore ways to make the chikungunya virus more transmissible, create a form of bird flu that is more dangerous to humans, and build an atlas of venom toxin peptides. Kevin Esvelt, an MIT biologist, warned that an AI had disclosed a novel form of bioweapon he hadn't realized was possible. Scientists urge caution and preparedness, with some suggesting existing guardrails are sufficient, while others highlight the need for stronger measures.

As things stand, the greatest risk of a pandemic isn't from a bioweapon but from pathogens already circulating, such as the H5N1 bird flu virus. However, the emergence of AI in biotech means the risks are evolving. Countries should strengthen their healthcare systems, prepare antidotes to known toxins, and stockpile medicines. We need to be prepared.