12 个前沿模型在 OpenDS-World 的 200 个真实网页研究任务中最好成绩仅 39%
香港科技大学(广州)、复旦大学、华盛顿大学、帝国理工学院等机构团队在 arXiv 预印本 Deep Search in Real-World Web Environments 中提出 OpenDS-World 基准,12 个受测前沿模型中最好成绩仅答对 200 个真实网页研究任务中的 39%。每个任务从一条视频线索出发,要求智能体在真实网站间发现、访问并串联证据,信息可能藏在交互页面、视听材料、科学图表或结构化文件中;任务配有经独立核验的证据链和唯一事实答案,而非预设的工具调用序列。所有模型共用同一工具环境,搜索预算为 3600 秒或 100 次工具调用,以先耗尽者为准。文中说明该准确率只反映这一基准和执行协议,不构成对研究助手的普遍排名。论文见 https://arxiv.org/abs/2610.30181,代码开源于 https://github.com/Yu-xm/OpenDS。
The best of 12 evaluated frontier models answers just 39% of OpenDS-World's 200 real-Web research tasks correctly.
A team spanning HKUST (Guangzhou), Fudan University, the University of Washington, Imperial College London and other institutions introduces the benchmark in an arXiv preprint, Deep Search in Real-World Web Environments.
Each task starts with a video clue and requires agents to discover, access and connect evidence across live websites. Information can sit inside interactive pages, audiovisual material, scientific figures or structured files. Independently verified evidence chains support unique factual answers, rather than a predefined sequence of tool actions.
All models share one tool environment and a search budget of 3,600 seconds or 100 tool calls, whichever runs out first. Finding a page is only part of the problem: choosing useful sources, recovering from failed interactions and deciding when the evidence is sufficient remain difficult. The reported accuracy describes this benchmark and execution protocol; it does not establish a universal ranking of research assistants.
Deep Search in Real-World Web Environments
Paper: https://arxiv.org/abs/2610.30181
Code: https://github.com/Yu-xm/OpenDS
Our Report: https://www.jiqizhixin.com/articles/2026-10-30-12
📬 #PapersAccepted by Jiqizhixin