Hidden State Genomics: Graph-Based Analysis of Sparse Auto-Encoder Feature Activity in Genomic Language Models
Eliot Kmiec, Samuel O'Brien, Matthew McCoy
The paper investigates genomic language model representations by analyzing sparse auto-encoder features, finding they encode granular sequence syntax and conservation patterns rather than complex regulatory logic.
bioRxiv · May 16, 2026 · PreprintBioinformatics