Skip to content

Translation in progress Some entries still include text in the original language.

AI Alignment Forum· orthonormal·Indexed by this site · Originally published

AI Alignment Forum 提案:先充分解决当前代模型的对齐问题,再训练下一代

Minimum required pacing: finish aligning it before you train the next one

AI summary

A proposal on the AI Alignment Forum suggests that labs must adequately resolve major alignment issues in their current-generation models before training the next generation. The proposal requires multiple independent alignment organizations to review and red-team the latest models at each training checkpoint, and to monitor them in restricted deployments with trusted users; if major alignment issues arise, the model should be taken down and a root-cause analysis conducted. The author states this is only a heuristic minimum standard, and questions such as how to define a "generation of models" and when to stop model development remain unresolved.

Read originalalignmentforum.org