Research

Mechanistic Interpretability

A controlled study of feature and attention circuits on Indirect Object Identification in GPT-2 small, testing whether attribution-based circuits hold up on held-out prompts rather than just the prompt they were built from.

PyTorch, TransformerLens, transcoders, causal interpretability