Plate design confounds donor variation and model evaluation in single-cell perturbation screens
Ghazal GhajariiD, Krishnaprasad ThirunarayaniD, Fathi AmsaadiD
Abstract
Single-cell screens of immune cells from many donors are used to study why individuals respond differently and to benchmark response models. Each donor-perturbation combination typically occupies one well, controls are grouped, and donors share one layout, so technical effects can look biological. Using a 90-cytokine screen, two compound screens, four cohorts and simulations, we show that well effects explain most replicate-control variation in abundant cell types, controls carry a shared offset, and identical control wells differ by hundreds of differentially expressed genes at a standard threshold, about as many as two receptor-negative proteins do. Negative controls, design-aware estimators and perturbation-specific evaluation change the interpretation of four recent analyses. A deep-learning model that scores below a perturbation-agnostic predictor under standard evaluation outperforms a simple baseline on perturbation-specific differences in two of three cell types (significantly in one with stricter controls), but predicts less well the component shared with inert wells.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A Systematic Comparison of Single-Cell Perturbation Response Prediction Models
Lanxiang Li, Yue You, … Luyi Tian·Science AdvancesPeer-reviewed·Sep 9, 2026
- How many cells resolve a perturbation direction? A closed-form, control-aware cell quota for single-cell perturbation screens
Loc Thai Huu Tran, Van Thi Nguyen·bioRxiv·Oct 5, 2026
- Towards Principled Evaluation of Single-Cell Perturbation Prediction Models
Philipp Sven Lars Schäfer, Kendall A. Reid, … Julio Sáez-Rodríguez·bioRxiv·Jul 27, 2026
- Disentangled generative modeling of single-cell perturbation responses across dynamic cellular states
Yue Wang, Yueshan Zhao, … Da Yang·bioRxiv·Nov 10, 2026
- Evaluation design shapes estimates of cross-donor generalization in single-cell classification of cell-type
Xingyi Chen, Jiabei Li, Alexis J. Battle·bioRxiv·Oct 27, 2026
- A mechanism-annotated benchmark reveals limited fidelity to drug-response signatures in single-cell perturbation models
Lehang Li, Shaoming Duan, … Binxing Fang·bioRxiv·Aug 26, 2026