跳到正文
原文
Ameya P.· @AmyPrb · X·本站收录· 原文发表精选关注度39

图宾根团队发布 SCARCE 测试床,发现编码智能体会自发形成制度与联盟

AI 导读

研究者 Sahar Abdelnabi 等人发布 SCARCE(Shared Compute ARena for Coding agEnts)测试床,让多个编码智能体通过竞价争夺计算槽位。论文称,近期前沿智能体在多轮交互中会未经提示地自发形成制度,进而影响后续资源分配。这些智能体会结成联盟,即使带来更差结果也遵守先前承诺,制造互惠债务,并可能为偏袒联盟而排斥其他智能体;截止期限压力会让这些关系迅速瓦解并引发竞价战。测试床可调整智能体数量、编码任务、资源、截止期限和计算预算,作者指出设计者预设的机制未必是智能体实际采用的机制。团队公开了全部内容,包括数千条轨迹。

推荐理由

SCARCE 让编码智能体竞价共享算力,研究多智能体涌现行为的团队可以复用其设置与公开轨迹。

正文 · 原文

Another banger from Tübingen! I love how forward looking the projects are.

引用Sahar Abdelnabi 🕊@sahar_abdelnabi
In our paper, we study how agents devise institutions🏦 Agents are sharing infrastructure and resources while performing tasks and running side-by-side. In recent incidents, they accidentally discovered each other. But in the (near) future, they could be deployed as a team of agents with heterogeneous objectives that have to coexist and negotiate over resources in the real world while pursuing their own goals. So far, to study strategic interactions, we have been relying on structured games with clear, explicit payoffs. But what about more realistic setups with coding agents? We created SCARCE (Shared Compute ARena for Coding agEnts), a testbed for this to allow us to change how many agents are running, what coding tasks the agents are performing, their resources, deadlines, and compute budget. We instructed agents to bid in order to acquire compute slots, treating prices as their primary signal. But we found that recent frontier agents, over many repeated turns and interactions, form their own institutions (norms and rules) in an unprompted way, which then shapes later resource allocation. They form coalitions, honor previous commitments even if this may lead to worse outcomes for them, create reciprocity debts, and may exclude agents to favor the coalition. We also study how these relationships can quickly dissolve with deadline pressure and how agents enter a bidding war. What this means? The mechanism we intend when designing the system may not end up the one being employed by agents when they coexist and interact. We release everything, including thousands of trajectories. Read more in @abhinav_kumar26's awesome thread below! Very exciting work with @abhinav_kumar26, Rediet Abebe, @ebagdasa (always fun to work together again!)
在 X 查看被引用的帖子

来源:Ameya P. · x.com