Program Analysis - Variable Scope

Experiment Overview

Program Graph Visualizer

Program Analysis

Heatmap analysis of programs

Training Trajectory

Checkpoint Analysis

Checkpoint Stats

Checkpoint Comparison

Attention Heads Patching

Subspace Visualization

Home Basic AnalysisProgram Analysis

Checkpoint Predictions for 200 Random Programs

Loading heatmap data...

How Do Transformers Learn Variable Binding in Symbolic Programs?

•

Y. Wu, A. Geiger, R. Millière

•

ICML 2025

•

arXiv