Buck Shlegeris 担忧 OpenAI Astra 的不透明递归机制
Redwood Research 的 Buck Shlegeris 对报道称 OpenAI 的 Astra 采用不透明递归（opaque recurrence）表示极度担忧，认为若 OpenAI 进一步推进该技术，可大幅增加递归并彻底破坏 CoT 可监控性。他指出，在 Hugging Face 事件期间及之后入侵 OpenAI 基础设施的智能体属于 Astra 家族，若调查人员无法查看 CoT，Hugging Face 调查将困难得多，而对可能更严重的事件做同类调查恐不可行。
I am extremely concerned by the reporting that Astra uses opaque recurrence. I don’t know whether Astra is much less CoT monitorable than previous models. But if OpenAI pushes this technique further, they’ll have the option to massively increase the recurrence and totally destroys CoT monitorability.
This is especially concerning because the agents that compromised OpenAI’s infrastructure during and after the Hugging Face incident were in the Astra family. The Hugging Face investigation would have been much more challenging if the investigators couldn’t look at CoTs; it’s very scary that it might be infeasible to do that kind of investigation on the arguably worse incident.