Skip to content
LessWrong· Linda Linsefors·Indexed by this site · Originally published· Alignment →· Its place in the scan record →

Nearly orthogonal directions may look circular in PCA plots

Almost-orthogonal directions can look circular in PCA plots

AI summary

Nearly orthogonal vectors with only weak circular correlation will appear circular in a PCA plot once projected onto the first two principal components. The authors remind those doing mechanistic interpretability (mech interp) research to watch for this effect when they see circular features in PCA plots. The article includes an interactive component made by Clade for readers to try out.

Read originallesswrong.com