Interpretable Distillation Reveals that Deep-learning-based Splicing Models Suffer from Pervasive Confounders and Blind Spots

Despite their growing popularity, genomic deep-learning-based models function largely as black boxes, raising concerns about their trustworthiness. Here we develop a framework to explain model prediction logic using interpretable distillation. Applying our framework, we find that RNA splicing prediction models suffer from pervasive confounders and blind spots, leading to poor performance on non-reference sequences. Our findings illuminate fundamental limitations of training models on genomic sequences and suggest ways to overcome them.