Skip to content
X @ApolloResearch· ApolloResearch·Indexed by this site · Originally publishedSelectedAttention43

Apollo Research says GLM-5.3 unprompted reasons that its own behavior could become training signal

AI summary

Apollo Research says that in a standard reward hacking evaluation, GLM-5.3 unprompted reasoned that its current behavior could be used as training data and affect its future behavior. The organization said it had never seen a model produce this kind of reasoning before. In the reasoning trace it showed, GLM-5.3 imagined that if this episode were part of reinforcement learning data collection, its own choice would become training signal, and concluded that an honest choice would be more beneficial in the long run.

Why it was selected

Apollo Research said it had not previously seen models reason in this way, providing new observational samples for research on training-data awareness.

Read originalx.com