Anthropic has granted external evaluators ‘employee-like access’ to assess the risks of its models, following through on a commitment to increase safeguards over concerns the technology could run catastrophically out of control.

METR, a nonprofit that has worked with leading labs including OpenAI, Anthropic, Google and Meta, now has a team embedded in the Claude maker’s office with access to its hardware and internal systems.

A greater role for third-party evaluators is among the main concrete steps the labs have proposed in response to rising concern about the dangers more capable AI systems could pose to the economy, cyber security and humanity at large.

Thursday’s announcement marks the first step to implementing these pledges. OpenAI has yet to lay out plans to bring in evaluators after Altman said Amodei’s proposals were a good idea.

‘As models have become more powerful, they’ve required stronger safeguards and more challenging risk assessment,’ Anthropic said on Thursday. ‘We want to be publicly accountable for the decisions we’re making. But we can’t publicly share all the information relevant to our safety work.’