paper

Eliciting Latent Predictions from Transformers with the Tuned Lens

Nora Belrose et al. · Mar 14, 2023

The rigorous successor to the logit lens: learn a per-layer affine probe so the read-off is faithful rather than approximate. Read it for the methodological standard the J-lens has to clear: how do you know an internal "prediction" you decode is really being used downstream, not an artefact of your decoder?

← Back to sources