Transcoders Find Interpretable LLM Feature Circuits

A key goal in mechanistic interpretability is circuit analysis: finding sparse sub-graphs of models corresponding to specific behaviors or capabilities.