Skip to content

上海人工智能实验室 · News

Oct 13 · Tuesday

上海人工智能实验室 · News

Latest publications and developments
Oct 5Mon
  1. arXiv:可解释性, 小红书 上海大学 刘东瑞 AI safetyarXiv:可解释性 · 2 sources · 2 reports · 53

    Agent deception can be predicted in advance from internal representations

    Researchers from institutions including Shanghai Artificial Intelligence Laboratory propose converting agent deception monitoring into a prediction problem of internal states before behavior occurs: extracting hidden states before the behavior-determining step and aggregating them into trajectory-level representations, using an MMD-based deep kernel detector to distinguish future honest and deceptive outcomes. On Qwen3-14B, representations seven steps ahead achieve 90.4% AUROC, comparable to the latest pre-decision representation's 89.4%; when accumulating prefixes from the trajectory start, average AUROC rises from 51.2% at the first step to 80.0% at the tenth step. The researchers also perform activation steering along honest and deceptive directions. Additionally, a note from Shanghai AI Lab transcribes discussion of this research question, involving post-hoc monitoring, spontaneous deception mechanisms, and the difference between predictive correlation and causal intervention; this note is an opinion transcription, and the underlying paper's identity and experiments have not yet been confirmed.

You have reached the end