Skip to content

Translation in progress Some entries still include text in the original language.

OpenAI Alignment Research· Tomek Korbak, Cameron Raymond, Micah Carroll, Marcus Williams, Mikita Balesni, Alan Guo, Jason Wolfe, Akshay Jagadeesh, Ian Kivlichan·Indexed by this site · Originally publishedSelectedAttention50

OpenAI 研究:对齐中间训练能泛化多远

How far does alignment midtraining generalize?

AI summary

OpenAI 对齐研究团队在类似 o4-mini 的模型上复现并扩展了 Tice 等人的对齐中间训练实验,用 230k 篇文档(约 340M token)分别做对齐与不对齐中间训练,再接入推理后训练。

Why it was selected

OpenAI 公开了一组对齐中间训练的负面结果,说明该干预在推理后训练和真实智能体场景中难以泛化,为后续对齐先验研究提供了可比较的基线。

Read originalalignment.openai.com