Anthropic announces employee-like internal access for METR evaluators
Anthropic has started giving six METR employees, from a nonprofit organization, access to internal tools and systems to assess risks in its models. METR may publish its findings without Anthropic’s veto, although some information may be redacted.
Anthropic announced that it has started giving six METR employees access similar to that of its own staff, including company hardware, office space, and internal tools and systems used by its risk-assessment teams. The nonprofit will be able to examine Anthropic’s models, safeguards, and practices and publish analyses of risk levels, incidents, or processes. Anthropic says it cannot veto the publications, but may require redactions in narrow categories, such as customer data, attorney-client privileged information, and model-architecture information; METR may publicly challenge those redactions without disclosing the hidden material.
Anthropic says it is also working with SecureBio and Accenture as evaluators and is in early discussions with other organizations, including Hugging Face. The company says the expanded access is intended to enable deeper independent assessments without exposing sensitive information or material that could be useful to malicious actors.
Why it matters · editorial interpretation
The arrangement expands independent scrutiny of Anthropic’s models, safeguards, and processes, allowing METR to publish analyses without the company’s veto except for narrow categories of redactions. This could give readers more detailed assessments, while keeping some sensitive information protected.
Sources: Anthropic