Cause-excluded Effect Evaluation: a framework for the faithful assessment of genetic perturbation target identification
Jiaxin HuiD, Xiaoning QiiD, Limeng Tian, Jie Yan, Nian Liu, Xin Li
Abstract
Identifying which gene drives a desired cell-state transition is a foundational inverse problem in target discovery and cell-state engineering, yet far less developed than forward prediction. We show that prevailing benchmarks inflate performance through two artefacts: training leakage, where test-perturbation cells are seen during fitting, and evaluation leakage, where the perturbed gene's own expression change exposes the answer. Here, we introduce Cause-excluded Effect Evaluation (CEE), a framework that separates train and test perturbation targets, removes target-gene self-effects from expression profiles and scores candidates in downstream response space. With CEE, we find that simple structure-based methods consistently outperform complex deep learning models across 16 single-cell perturbation datasets, revealing that the recoverable signal is governed by low-rank and additive structure in perturbation responses rather than by model complexity. Our work disentangles evaluation artefacts from genuine predictive capacity and offers a design principle for developing perturbation target identification methods.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Deep Learning-Based Genetic Perturbation Models Do Outperform Uninformative Baselines on Well-Calibrated Metrics
Henry E. Miller, Gabriel Mejia, … Lucas Paulo de Lima Camillo·bioRxiv·Oct 20, 2025
- SHERLOCK: Structured representation learning and causal inference of downstream perturbation effects
Mingxuan Zhang, Joshua D. Myers, … Elham Azizi·bioRxiv·Sep 26, 2026
- Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models
Junwei Sun, Yuxun He, … Yiqun T. Chen·bioRxiv·Jul 24, 2026
- Spurious correlation inflates performance in single-cell perturbation prediction
Phillip B. Nicol, Shriya Shivakumar, Rafael A. Irizarry·bioRxiv·Aug 11, 2026
- Towards Principled Evaluation of Single-Cell Perturbation Prediction Models
Philipp Sven Lars Schäfer, Kendall A. Reid, … Julio Sáez-Rodríguez·bioRxiv·Jul 27, 2026
- GenePert: Leveraging GenePT Embeddings for Gene Perturbation Prediction
Yiqun T. Chen, James Zou·bioRxiv·Oct 27, 2024