Training Trajectory - Variable Scope

Experiment Overview

Program Graph Visualizer

Program Analysis

Training Trajectory

Model learning progression

Checkpoint Analysis

Checkpoint Stats

Checkpoint Comparison

Attention Heads Patching

Subspace Visualization

Home Basic AnalysisTraining Trajectory

Select Metric

How Do Transformers Learn Variable Binding in Symbolic Programs?

•

Y. Wu, A. Geiger, R. Millière

•

ICML 2025

•

arXiv