World Model · podcast knowledge graph

The Utility of Interpretability — Emmanuel Amiesen

2025-06-06 · 113 min · 12 entities

episode page audio

Asserted relationships

  • → discusses Science concept
    0.40
    evidence rules-v4
    Feed category: Science
  • → discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology
  • → references Attribution Graphs person
    0.38
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://transformer-circuits.pub/2025/attribution-graphs/methods.html
  • → references Open Source Circuit Tracing person
    0.38
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://anthropic.com/research/open-source-circuit-tracing
  • → references Gemma 2 2b website
    0.38
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://neuronpedia.org/gemma-2-2b/graph

Entities found in this episode

persons 4

  • mentioned Attribution Graphs person
    0.45
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://transformer-circuits.pub/2025/attribution-graphs/methods.html
  • mentioned Open Source Circuit Tracing person
    0.45
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://anthropic.com/research/open-source-circuit-tracing
  • references Attribution Graphs person
    0.38
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://transformer-circuits.pub/2025/attribution-graphs/methods.html
  • references Open Source Circuit Tracing person
    0.38
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://anthropic.com/research/open-source-circuit-tracing

concepts 3

  • mentioned Science concept
    0.50
    evidence rules-v4
    Feed category: Science
  • mentioned Emmanuel Amiesen concept
    0.42
    evidence rules-v4
    The Utility of Interpretability — Emmanuel Amiesen
  • discusses Science concept
    0.40
    evidence rules-v4
    Feed category: Science

companys 2

  • mentioned Technology company
    0.50
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology

websites 2

  • mentioned Gemma 2 2b website
    0.45
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://neuronpedia.org/gemma-2-2b/graph
  • references Gemma 2 2b website
    0.38
    evidence rules-v4
    Link in episode "The Utility of Interpretability — Emmanuel Amiesen": https://neuronpedia.org/gemma-2-2b/graph

books 1

Episode description as stored
Emmanuel Amiesen is lead author of “Circuit Tracing: Revealing Computational Graphs in Language Models” (https://transformer-circuits.pub/2025/attribution-graphs/methods.html ), which is part of a duo of MechInterp papers that Anthropic published in March (alongside https://transformer-circuits.pub/2025/attribution-graphs/biology.html ). We recorded the initial conversation a month ago, but then held off publishing until the open source tooling for the graph generation discussed in this work was released last week: https://www.anthropic.com/research/open-source-circuit-tracing This is a 2 part episode - an intro covering the open source release, then a deeper dive into the paper — with guest host Vibhu Sapra (https://x.com/vibhuuuus ) and Mochi the MechInterp Pomsky (https://x.com/mochipomsky ). Thanks to Vibhu for making this episode happen! While the original blogpost contained some fantastic guided visualizations (which we discuss at the end of this pod!), with the notebook and Neuronpedia visualization (https://www.neuronpedia.org/gemma-2-2b/graph ) released this week, you can now explore on your own with Neuronpedia, as we show you in the video version of this pod. Full Video Episode Timestamps 00:00 Intro & Guest Introductions 01:00 Anthropic's Circuit Tracing Release 06:11 Exploring Circuit Tracing Tools & Demos 13:01 Model Behaviors and User Experiments 17:02 Behind the Research: Team and Community 24:19 Main Episode Start: Mech Interp Backgrounds 25:56 Getting Into Mech Interp Research 31:52 History and Foundations of Mech Interp 37:05 Core Concepts: Superposition & Features 39:54 Applications & Interventions in Models 45:59 Challenges & Open Questions in Interpretability 57:15 Understanding Model Mechanisms: Circuits & Reasoning 01:04:24 Model Planning, Reasoning, and Attribution Graphs 01:30:52 Faithfulness, Deception, and Parallel Circuits 01:40:16 Publishing Risks, Open Research, and Visualization 01:49:33 Barriers, Vision, and Call to Action This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.latent.space/subscribe