Interpretable weight-space programming builds transparent Transformers and brain encoding models
Interpretable weight-space programming builds transparent transformers and brain encoding models
The authors propose interpretable weight-space programming (iWSP), in which LLM agents iteratively build interpretable models by writing model weights and features directly in code without backpropagation; the agents must rely on prior knowledge and reason about past trials, proposing hypotheses, manually constructing and improving human-interpretable computations, and an LLM audit confirmed the interpretability of these hand-built models. The authors first had iWSP build compact and accurate Transformers on benchmarks such as arithmetic and sentiment classification, then applied it to neural encoding models of vision, language and hearing: on visual cortex it outperformed existing interpretable baselines in prediction, revealed different computations in early and higher visual areas, and generalized to unseen data; in language fMRI it revealed confounders in the data, and in auditory ECoG it systematically found interpretable acoustic features that predict neural activity. The authors say these results establish iWSP as a general paradigm combining high predictive performance with human-interpretable scientific discovery.
Related events and news
1 events · 1 news mentions
News that mentions this paper
微软等提出iWSP,LLM手写Transformer权重
- 公众号 新智元cites the paper's id or link不用训练!Opus 5.5直接手写Transformer权重,13类算法任务全拿100%