MIT CSAIL research says AI directly modifies Qwen3.5-0.8B weights, MATH-500 rises from 7.9% to 48.1%
MIT CSAIL research is said to have an AI directly modify about 0.016% of Qwen3.5-0.8B's weights, raising MATH-500 from 7.9% to 48.1%, about 6 times, without training or LoRA. The poster says Qwen's improvement mainly comes from fixing a reasoning infinite loop; the research team also observed essentially no improvement on Gemma 3 270M, which has no obvious infinite loop. The poster also says their similar weight-editing attempt on a person-recognition network showed no effect.
😲 让人兴奋得有点害怕。MIT CSAIL直接让 AI 编辑权重文件,数学性能提升了 6 倍。
直接编辑权重,不用训练!
传统路子,靠微调或 LoRA。这次他们让 AI修改 Qwen3.5-0.8B 约 0.016% 的权重,MATH-500 从 7.9% 飙到 48.1%。结果真干成了。
🤔 Qwen 的提升主要是修复了推理死循环。
我早上拿人物识别网络试过类似的权重编辑,没什么效果。
研究团队对没有明显死循环的 Gemma 3 270M,也基本没提升。
🔥 这条路还是很牛逼的。
直接改神经网络,可能可以揭开 AI 神秘面纱。
原文在
https://x.com/rikiyatakehi/status/2117313742891327994
中文版 👇
https://x.com/i/article/2117400954589073408View the quoted post on X