Skip to content
Marius Hobbhahn· @MariusHobbhahn · X·Indexed by this site · Originally published· Governance →· Its place in the scan record →

METR updates its loss-of-control evaluation proposal, clarifying that companies may designate which employees evaluators interview

AI summary

METR updated its proposal for upcoming loss-of-control evaluations, clarifying which employees companies may designate for evaluators to speak with privately, provided the approval process is transparent; the changelog states that developers may restrict METR's interviews to employees they approve. Beth Barnes's explanatory post says that similar evaluations in other industries usually have stronger safeguards, such as OSHA inspectors being able to question employees privately, NRC (nuclear) inspectors being able to speak with workers privately, SEC rules prohibiting obstruction of anyone reporting suspected securities violations to it, and similar provisions in the Joint Commission hospital accreditor and auditing standard ISA 210. METR says it still requires the ability to speak privately with approved employees on in-scope topics, and is currently willing to conduct evaluations under the condition of interviewing only company-approved employees; evaluations to date, including the AI R&D acceleration evaluation with Anthropic, have been conducted this way, and it commits to publicly documenting how the approval process actually works, other restrictions on interviews, and whether employees fear retaliation. Marius Hobbhahn, who reposted the post, says the ideal state should be to allow all lab employees, including non-safety employees, to share information on any safety-related matter with on-site evaluators.

Full text · Original

I'm not sure if I read the post correctly, but I just want to state clearly that I think the ideal state would be for all lab staff to be allowed to share information about anything safety related with the embedded evaluators even non-safety staff and large scope.

Quoted postElizabeth Barnes@BethMayBarnes
We’re clarifying one of the “key terms” from METR’s proposal for upcoming loss-of-control assessments: Previously I summarized this term as “staff can freely share info [with] us on in-scope topics”. However, since publishing we clarified our position internally that it’s ok for a company to approve which staff we can talk with, as long as there’s transparency around these approvals. We’ve updated our proposal to reflect this. We still require that we’re able to talk with approved company staff privately on in-scope topics. As far as I can tell, this isn’t necessarily the norm for this kind of assessment in other industries, where there are often provisions to ensure the company cannot prevent staff from freely sharing relevant information with assessors, especially in highly regulated or safety-critical industries. There are also often stronger protections against retaliation for sharing information. For example: - OSHA inspectors can “question privately any such employer, owner, operator, agent, or employee.” - NRC (nuclear) inspectors “may consult privately with workers” to the extent the inspectors see fit. Workers may also privately raise suspected violations with inspectors during an inspection. - SEC: no one may impede a person from communicating with the SEC about possible securities law violations, including through confidentiality agreements. Those examples are government regulators, but there are also examples involving nonprofits - for example, the Joint Commission, the private nonprofit that accredits most US hospitals, requires that anyone providing care can report safety or quality concerns to it “without retaliatory action from the hospital,” and the hospital must tell their staff this. The ISA 210 (international standard on financial auditing) also says the auditor should have “unrestricted access to persons within the entity from whom the auditor determines it necessary to obtain audit evidence”. Within AI, the AI Evaluator Forum’s public letter “Minimum Conditions for Embedding Evaluators” calls for “candid and direct one-on-one communication with relevant staff”. While provisions like the above would more robustly inform the public, for the moment, METR is willing to conduct assessments where our assessors only speak with company-approved employees. This has been the case in our assessments thus far - for example, in our AI R&D acceleration assessment with Anthropic, and other recent assessments. We will ensure we can be transparent about how the approval process worked in practice, any other constraints on the interviews including whether staff seemed worried about retaliation, and how this impacted our investigation.
View the quoted post on X

Source: Marius Hobbhahn · x.com