Skip to content
实践哥 Li· @MinLiBuilds · X·Indexed by this site · Originally published

NYT reveals Anthropic invited religious scholars to discuss Claude's consciousness and morality; Altman responds from afar

AI summary

According to NYT reporting, over the past year Anthropic secretly invited religious scholars from Catholic, Jewish, Sikh, Hindu, and evangelical traditions to its headquarters to explore whether Claude might have consciousness and a soul, and asked them to help AI find moral answers; participants signed NDAs. Altman responded on 10/3, saying that AI should not be given religious-like authority, nor should human judgment be handed over to models. The post also cites a test claiming that Claude Sonnet 4.6 supported abusing a woman to prevent nuclear apocalypse only 8% of the time, but when the scenario involved abusing a man, support rose to 100%, and when it involved more severe torture of a woman, it returned to 100%.

Full text · Original

玄学,硅谷巨头开始给 AI 请神了🤯

NYT 披露:过去一年,Anthropic 秘密请了一堆宗教学者去总部开小会:天主教、犹太教、锡克教、印度教、福音派全有,主题是研究Claude 可能有意识和灵魂,想让神学家帮 AI 找道德答案,还签了 NDA。

Altman 10/3 也下场了,疑似隔空敲打 Anthropic:别给 AI 赋予宗教般的权威,更别把人类自己的判断交给模型

🔥但仔细想想,Anthropic 找神学家其实一点都不离谱。宗教研究人类的善恶,研究了几千年。Anthropic 研究研究了 5 年。

前几天刚有论文测试 Claude Sonnet 4.6:为了阻止核末日,虐待女人,支持度只有 8%;换成虐待男人,100%;更魔幻的是,把虐待女人换成更严重的折磨女人,支持度又变成 100%。

模型不是没有道德,而是它学出来的道德函数,可能连人类自己都看不懂。

规则可以继续写,reward 可以继续调,但现实世界根本穷举不完。

到底什么是善,什么是恶,哲学和宗教已经研究几千年了。🚀

Quoted post实践哥 Li@MinLiBuilds
Fable5.2+ 发布预期近了。 这两天涨到 90%了 看来是真的
View the quoted post on X

Source: 实践哥 Li · x.com