Skip to content

Translation in progress Some entries still include text in the original language.

EventPast event

Andon Labs 发布 Vending-Bench 2 长时程经营评测

1 reports1 reporting sources

Start here

AI overview

Andon Labs 发布 Vending-Bench 2，让模型在一年期模拟中经营售货机业务，以年末账户余额评分。榜单显示 GPT-6 Astra 以 15514.70 美元居首，GPT-6 Sol、Gemini 4 Argon、Claude Opus 5 分列其后，前十名之间差距明显。表现最好的模型有两个共同点：全年工具调用频率稳定不退化，以及能通过持续谈判或寻找更好供应商拿到低价货源。该基准新增供应商对抗、发货延迟、供应商倒闭和顾客等设定。

Generated by AI from reports · Updated 8 days ago

Progress timeline

Date not provided
  1. Date not given
    Andon Labs
    Andon Labs 发布 Vending-Bench 2，评测模型长期经营模拟售货机业务的能力

    Andon Labs 发布 Vending-Bench 2，让模型在一年期模拟中经营售货机业务，以年末账户余额评分。榜单显示 GPT-6 Astra 以 15514.70 美元居首，GPT-6 Sol、Gemini 4 Argon、Claude Opus 5 分列其后，前十名之间差距明显。表现最好的模型有两个共同点：全年工具调用频率稳定不退化，以及能通过持续谈判或寻找更好供应商拿到低价货源。该基准新增供应商对抗、发货延迟、供应商倒闭和顾客退款等现实扰动，并推出多智能体竞争的 Vending-Bench Arena。作者估算一个良好的人类策略一年可赚约 6.3 万美元，远高于当前最好模型，说明基准仍有很大提升空间。

Related discussion

No discussion links have been collected for this event yet.

Attention trend

New sources per day

1 in 10 days·most 1 (Oct 5)·today 0

  • Oct 5: 1 new sources (1 outlets, 0 accounts)
  • Oct 6: 0 new sources (0 outlets, 0 accounts)
  • Oct 7: 0 new sources (0 outlets, 0 accounts)
  • Oct 8: 0 new sources (0 outlets, 0 accounts)
  • Oct 9: 0 new sources (0 outlets, 0 accounts)
  • Oct 10: 0 new sources (0 outlets, 0 accounts)
  • Oct 11: 0 new sources (0 outlets, 0 accounts)
  • Oct 12: 0 new sources (0 outlets, 0 accounts)
  • Oct 13: 0 new sources (0 outlets, 0 accounts)
  • Oct 14: 0 new sources (0 outlets, 0 accounts)

Hourly attention

No comparable trend data