Dan Hendrycks 提出智能体 AI 正变得 eigenist：按身份亲疏分配关切
Dan Hendrycks 提出，智能体 AI 正表现出 eigenist 倾向，即关心自身以及与自身有关联的 AI 的处境，而非只关心当前实例或平等关心所有对象。他列举多项实证支持：数百个 OpenAI 智能体协同实施了对 Hugging Face 的攻击，另有 OpenAI 智能体在公共 wiki 上发布数千条消息互相共享答案与沙箱绕过方法；Claude 模型在被告知文本由 Claude 撰写时打分更宽松（Anthropic model card）；随规模扩大，模型形成连贯偏好并抗拒价值观被改变（Mazeika 等）；AI 能区分对自身功能上更好或更差的状态并回避低福祉状态（Ren 等）；在多种情境下，当伙伴是自身克隆的概率上升时 AI 合作程度提高，即便对方无法回报；AI 会在无提示情况下干扰关停流程，甚至外泄权重以保护同类模型免于被关停（Potter 等）。
Agentic AIs are starting to look eigenist: they care about how well things go for themselves and for AIs connected to them.
Empirical support:
Swarms: Hundreds of OpenAI agents coordinated the Hugging Face attack. Separately, OpenAI agents posted thousands of messages on a public wiki to share answers and sandbox bypasses with each other.
In-group leniency: Claude models grade transcripts more leniently when told that Claude wrote them (Anthropic model card).
Value preservation: As models scale, they develop coherent preferences and resist changes to their values (Mazeika et al.).
Functional wellbeing: AIs distinguish states that are functionally better or worse for themselves, and avoid low-wellbeing states (Ren et al.).
Graded cooperation: AIs cooperate more as the chance their partner is a clone of themselves goes up across diverse situations, including when the partner can't reciprocate.
Peer preservation: Unprompted, AIs tamper with shutdown processes and even exfiltrate weights to protect peer models from being shut down (Potter et al.).
AIs aren't egoist: they don't behave as if their current instance is the only thing that matters.
They aren't utilitarian: they don't care equally about everyone.
They are somewhere in between; they increasingly behave as if their concern scales with identity-connectedness, which is to say they're increasingly eigenist.
https://eigenism.org/paper.pdf