Join waitlist
Back to products
Circuit Tracer

Circuit Tracer

Anthropic's open tools to see how AI thinks

Website anthropic.com
Overview

What it is

Anthropic's open-source Circuit Tracer helps researchers understand LLMs by visualizing internal computations as attribution graphs. Explore on Neuronpedia or use the library. Aims for AI transparency.

Intent

I need it when

Test hypotheses about model behavior by modifying internal feature values and observing output changes

Circuit Tracer enables hypothesis testing by allowing users to modify feature values within traced circuits and observe how model outputs change, supporting iterative research and validation

Build on existing interpretability research and contribute to the broader AI safety community

The open-source library and code repository allow researchers to extend the tools, analyze additional circuits, and share findings with the community, lowering barriers to interpretability research

Understand how large language models make decisions by examining their internal reasoning steps

Circuit Tracer generates attribution graphs that reveal the computational steps a model took to produce a specific output, enabling researchers and developers to trace and visualize model reasoning on supported open-weights models like Gemma-2-2b and Llama-3.2-1b

Study specific model behaviors such as multi-step reasoning or multilingual representations

The tool allows users to generate, visualize, annotate, and share attribution graphs through an interactive Neuronpedia frontend, with demo notebooks showing analysis of multi-step reasoning and multilingual representations

Drop

Not a fit when

  • User needs to trace circuits on proprietary or closed-source models not supported by the open-source library
  • User requires commercial support, SLAs, or guaranteed uptime for production systems
  • User lacks technical expertise to set up and run the open-source library or access GitHub repositories
  • User needs real-time model monitoring or continuous circuit tracing in production environments
  • User operates in a regulated industry requiring vendor liability, indemnification, or formal support contracts
Commercials

Pricing

Free open-source library with optional interactive frontend hosted by Neuronpedia