Blindfold: keeping audit coins secret from LLM agents
Blindfold: Keeping the Audit Coin Secret from LLM Agents
The paper points out that audit-based certification providing an upper bound on the violation rate of LLM agents also relies on a confidentiality property, namely that the audit coin must not affect the agent's view before an action is submitted, which the authors call pre-submission non-interference (PNI). The paper proves that PNI is both necessary and sufficient for unbiased certificates for adaptive agents, with worst-case bias (1-ε)D_A; leakage accumulates across steps, resources shared across turns open a channel whose size can be computed, and increasing the audit rate cannot restore validity. On the monitor the authors built, silent auditing does not change the output, but the added latency is exposed by tool timestamps and can be amplified by the agent; in experiments, a real LLM agent complied with an injection that mentioned a visible audit notice, and through this channel ordinary certificates failed on the measured labels, and post-hoc analysis showed that they also failed in one live run conducted according to a pre-registered schedule, whereas silent auditing restored the certificates. Using a fresh coin for each audited call can close this timing channel, and padding can only narrow it.
Related events and news
1 events · 1 news mentions
News that mentions this paper
周报:预训练投毒可植入智能体后门
- 公众号 大模型安全研究cites the paper's id or link大模型安全周报:首次证明预训练投毒可植入远程代码执行后门,技能供应链成为攻防主战场
2. 审计抽检要藏硬币,否则自适应智能体可造成最高 (1-ε)·D 认证偏差:Blindfold: Keeping the Audit Coin Secret from LLM Agents(https://arxiv.org/abs/2610.37055)