FAR.AI deception workshop summary: why white-box monitoring is more promising than black-box

FAR.AI held a research workshop focused on AI deception detection. Chris Cundy proposed that more effort should be invested in white-box monitoring methods that observe the model's internal computations, rather than black-box monitoring that only examines outputs—the latter requires a trusted monitor at least as capable as the model being monitored and cannot access knowledge the model holds internally but does not express. Neel Nanda (Google DeepMind), Joseph Bloom (UK AISI), Micah Carroll (OpenAI), and Cadenza Labs' Walter Laurito and Kieron Kretschmar gave talks on standards for evidence of misalignment, the current state and future of systemic monitorability, chain-of-thought monitorability, and the deception detection benchmark Liars Bench, respectively.