OpenAI auditor clarifies: only company-approved employees, no quoting or summarizing
OpenAI external auditor Beth May Barnes clarified that auditors cannot freely speak "privately" with anyone at the company, only with company-approved employees, and that even information from approved employees cannot be quoted or summarized. This clarification responds to tszzl's earlier statement, in a discussion of OpenAI's external audit arrangements, that "these auditors seem able to speak privately with anyone at the company"; she also apologized for not having explained this clearly earlier.
"it sounds to me like these auditors can freely talk to anyone at the company 'off the record'" -> This is not the case, we can only talk with company-approved staff. Additionally, we cannot quote or summarize info even from approved staff. Sorry if we didn't communicate this well.
i agree that this does not seem employee like and therefore does not live up to the original premise. it’s an odd compromise that’s 80% of the way there in terms of employee like access but baroque enough that it gets 20% of the public credit. what anthropic outlined with their METR deal seems more straightforwardly 'employee like' (at least as far as publicly known)
that being said i know how hard many people worked to get even to this point, and imo it will accomplish all of the strategic objectives for "pacing the frontier" 1.0 by at the least verifying where the frontier is. the assessment contracts will grow quickly past "first phase"
it sounds to me like these auditors can freely talk to anyone at the company 'off the record'. for stuff that informs the public reports it then needs to go through official channels. this is how i understand embedded auditing works in other settings
separately, I actually do think openai is quite transparent with misalignment reporting / RSI progress / and so on, and there is a broad oversight mechanism that comes from the nonprofit board Paul Christiano et al that may not be obvious on the outsideView the quoted post on X