henhao
Sign in
BioinformaticsbioRxiv
Preprint

GDTR: Layer-wise Settling Depth Reveals Biological Grammar in Genomic Foundation Models

Yoonjin ChoiD, J Y KangiD, Subin ParkiD, Sangwoo KimiD

PDFDOI

Abstract

Genomic foundation models capture sequence regularities, yet existing interpretability tools rarely ask where in the layer stack a biological grammar becomes stable. We introduce GDTR (Genomic Deep-Thinking Ratio), a training-free residual-stream lens that assigns each nucleotide token a settling depth c(t): the first layer at which its representation stabilises against the post-final-norm reference. On Evo 2 7B, splice donor and acceptor sites settle approximately two layers earlier than intronic contexts, enhancer-like cCREs show a smaller but measurable shift, and a chr22 calibration transfers to held-out chr17. Perturbing canonical splice donors shows that the signal is bidirectional: disrupting the central GT motif deepens settling, whereas shuffling the flanking grammar makes the preserved motif settle earlier. Differential GDTR further reveals consequence-associated peak-disruption depths across ClinVar variants, with synonymous substitutions peaking deepest but with broad class overlap. GDTR therefore provides a layer-wise interpretability axis for genomic foundation models, complementary to existing prediction and variant-scoring tools.

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.