arXiv· arXiv:2601.15679· Ee Wei Seah, Yongsen Zheng, Naga Nikshith, Mahran Morsidi, Gabriel Waikin Loh Matienzo, Nigel Gay, Akriti Vij, Benjamin Chua, En Qi Ng, Sharmini Johnson, Vanessa Wilfred, Wan Sie Lee, Anna Davidson, Catherine Devine, Erin Zorer, Gareth Holvey, Harry Coppock, James Walpole, Jerome Wynee, Magda Dubois, Michael Schmatz, Patrick Keane, Sam Deverett, Bill Black, Bo Yan, Bushra Sabir, Frank Sun, Hao Zhang, Harriet Farlow, Helen Zhou, Lingming Dong, Qinghua Lu, Seung Jang, Sharif Abuadbba, Simon O'Callaghan, Suyu Ma, Tom Howroyd, Cyrus Fung, Fatemeh Azadi, Isar Nejadgholi, Krishnapriya Vishnubhotla, Pulei Xiong, Saeedeh Lohrasbi, Scott Buffett, Shahrear Iqbal, Sowmya Vajjala, Anna Safont-Andreu, Luca Massarelli, Oskar van der Wal, Simon Möller, Agnes Delaborde, Joris Duguépéroux, Nicolas Rolin, Romane Gallienne, Sarah Behanzin, Tom Seimandi, Akiko Murakami, Takayuki Semitsu, Teresa Tsukiji, Angela Kinuthia, Michael Michie, Stephanie Kasaon, Jean Wangari, Hankyul Baek, Jaewon Noh, Kihyuk Nam, Sang Seo, Sungpil Shin, Taewhi Lee, Yongsu Kim·本站收录· 原文发表
多国AI安全研究所联合改进跨领域智能体评测方法学：敏感信息泄露、欺诈与网络安全威胁
Improving Methodologies for Agentic Evaluations Across Domains: Leakage of Sensitive Information, Fraud and Cybersecurity Threats
AI 导读
国际先进AI测量、评估与科学网络（International Network for Advanced AI Measurement, Evaluation and Science）的多国参与者联合开展第三轮智能体评测练习，以对齐智能体评测方法、完善先进AI系统测试的最佳实践，参与者来自新加坡、日本、澳大利亚、加拿大、欧盟委员会、法国、肯尼亚、韩国和英国。练习分为两部分：新加坡 AISI 牵头敏感信息泄露与欺诈等共同风险，UK AISI 牵头网络安全。测试将开放与闭源权重模型混合，对照多个公开智能体基准的任务进行评估。鉴于智能体测试尚处早期，本轮重点是理解测试的方法学问题，而非检验测试结果或模型能力；此前两轮联合测试分别于2024年11月和2025年2月进行。