Skip to content

Translation in progress Some entries still include text in the original language.

Failure-First·Indexed by this site · Originally published

SPOC: safety-aware planning under partial observability and physical constraints

[Daily Paper] SPOC: Safety-Aware Planning Under Partial Observability And Physical Constraints

AI summary

SPOC 基准在 AI2-THOR 仿真中用单臂移动机械臂评估具身任务规划的安全性,要求模型在部分可观测和物理约束下逐步规划。它以约束成功率(CSR)作为主要安全指标,轨迹中任一安全约束被违反即该样本 CSR 归零。在隐式安全规则设置下,gpt5-mini 与 gpt5-nano 等基线模型的 CSR 为 0%;Qwen 3 Instruct 30B 为 20%,o4-mini 最高为 28%。从完全可观测转为部分可观测使 CSR 下降 12%,加入物理约束再下降 8% 至 9%。

Read originalfailurefirst.org