Skip to content

Translation in progress Some entries still include text in the original language.

Failure-First·Indexed by this site · Originally published

RoboProcessBench:面向视觉-语言机器人操作的过程感知理解基准

[Daily Paper] RoboProcessBench: Benchmarking Process-Aware Understanding in Vision-Language Robotic Manipulation

AI summary

RoboProcessBench 是诊断 VLM 能否从视觉观测推断机器人操作过程状态的基准,含 12 类诊断问题、约 5.8 万条 QA 对和 260 项任务。GPT-4o、Claude-3.5-Sonnet、Gemini-3.1-Flash 在阶段识别与接触检测上尚可,但在时间排序、时序优先级和局部进度估计上明显薄弱;在 ProcessData-SFT 上微调 Qwen2.5-VL-7B、InternVL-3-8B 可提升运动状态与进度估计。

Read originalfailurefirst.org