Atlas-scale single-cell analysis beyond in-memory paradigm with scAtlasPy
Han XuiD, Yangzhan Ye, Senpeng Zhang, Runzhi Xie, Junping LiiD, Jiadong LiniD, Yuxuan HuiD, Lin GaoiD
Abstract
Single-cell atlases are rapidly outgrowing the memory capacity of standard workstations, challenging the in-memory paradigm underlying mainstream computational ecosystems. Here, scAtlasPy decouples scale of atlas from memory capacity by leveraging the disk-resident computing. It enables full-resolution analysis of a 100-million-cell atlas with only 42.9 GB peak memory, whereas state-of-the-art platforms are limited at 3 million cells with 512 GB memory. scAtlasPy achieves 137,745 cells/s, 10.4x faster than scDataset with 82.6% lower memory usage for random minibatch retrieval. Its extensible architecture offers a flexible platform for diverse atlas-scale analytical tasks, facilitating the discovery of complex cellular heterogeneity and functions in massive cell atlases.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- AtlasMap: enabling low-cost, map-style exploration of million-cell single-cell atlases
Zhou-Geng Xu, Hao-Chen Xue, … Jiawei Wang·bioRxiv·Jan 16, 2026
- Scalable high-performance single cell data analysis with BPCells
Benjamin E. Parks, William James Greenleaf·bioRxiv·Mar 27, 2025
- Fast and lightweight cell atlas approximations across organs and organisms
Ying Xu, Joanna Ahn, Fabio Zanini·bioRxiv·Jan 3, 2024
- Scarf: A toolkit for memory efficient analysis of large-scale single-cell genomics data
Parashar Dhapola, Johan Rodhe, … Göran Karlsson·Nature CommunicationsPeer-reviewed·Aug 8, 2022
- Scope+: An open source generalizable architecture for single-cell atlases at sample and cell levels
Danqing Yin, Yue Cao, … Jean Yee Hwa Yang·bioRxiv·Dec 3, 2022
- SingleRust: A High-Performance Toolkit for Single-Cell Data Analysis at Scale
Ian Ferenc Diks, Matthias Flotho, Andreas Keller·bioRxiv·Aug 4, 2025