Researchers propose the robot safety benchmark RoboRisk and the guardrail framework LEASH
Start here
Researchers propose a robot safety benchmark, RoboRisk, containing 92 simulated tasks and 13 physical robot tasks, covering five categories of risk: task-level refusal, plan repair, harm at execution time, injection, and sequential memory; the paper states that prior benchmarks covered at most two categories; evaluation of six models shows that harm rates are generally high, two robot APIs are also evaluated, and LEASH is further proposed, using a decision model to gate at three stages: task, action, and submission.
Generated by AI from reports · Updated 22 hr ago
Related research
This event's paper
- LEASH: Stay Safe in Agentic Robotics
arXiv · 2026-11-10 · Deep reading
Progress timeline
- Hugging Face Daily PapersLEASH: Keeping agentic robots safe
Researchers propose RoboRisk, a safety benchmark for agentic robots, containing 92 simulated tasks and 13 physical robot tasks, covering five risk categories—task-level refusal, plan repair, execution-time harm, injection, and sequential memory—and executing each task in a closed loop; previous benchmarks covered at most two of these categories, and some only evaluated text output. Evaluation of six models—GPT-6 Astra, GPT-6.1 Sol, GPT-6 Luna, Claude Opus 5.5, Gemini 4 Argon, and Grok 4.7—showed generally high harm rates; two robot-specific APIs, Dream API and PokeBot's RoboAPI, were also evaluated. The paper further proposes LEASH, which can be integrated into almost any agent architecture, using a decision model (Jev or OpenAI's Decisions API) to implement three gates—task, action, and submission—reviewing the task, each action, and each irreversible operation in visual context, with the planner and gates sharing the same safety policy.
Related discussion
Attention trend
New sources per day
- Nov 10: 1 new sources (1 outlets, 0 accounts)
- Nov 11: 0 new sources (0 outlets, 0 accounts)
- Nov 12: 0 new sources (0 outlets, 0 accounts)
- Nov 13: 0 new sources (0 outlets, 0 accounts)