bioRxivNeurosciencePreprint
NeuroPilot: Longitudinal intravital neural imaging across scales and modalities through an agentic platform
Guoxun ZhangiD, Yuhong Luo, Furong Ju, Dengyu Liu, Dong ZhangiD, 郭长亮 Guo Changliang, Jiaying Han, Shan QiuiD, Tianyun WangiD, Jun Wang, Mingyang MaiD, Bo LiiD, Yanjun JiangiD, Wei Pengfe, Xiaodong LiuiD, Nan Chi, Ziwei LiiD
Abstract
Longitudinal intravital imaging is essential for understanding how neural populations evolve across behavioral states, yet converting large-scale recordings into biological insight remains a fundamental challenge because neural signals are degraded by noise, non-rigid motion, and heterogeneous recording conditions. Here we introduce NeuroPilot, an agentic framework that transforms neural imaging analysis into a closed-loop, context-aware process, integrating a multimodal large language model with callable computational imaging modules to adaptively coordinate workflows from raw recordings to population-level readouts. Across heterogeneous imaging and experimental regimes, NeuroPilot restores motion-degraded recordings and supports consistent neural signal recovery, detection, and tracking in challenging deep-brain, freely moving, and longitudinal settings. These enable neuronal population tracking across spinal stimulation paradigms, deep-brain imaging, and continuous 24-hour mPFC recordings aligned with spontaneous sleep-wake behavior. By converting heterogeneous intravital recordings into stable population activity maps, NeuroPilot supports behavioral decoding and reveals structured neural dynamics across behavioral states and transitions. NeuroPilot establishes a scalable agentic paradigm for neural imaging analysis, expanding experimental access to the measurement, visualization, and interpretation of neural population activity.
- organism: mouse
- assay: imaging
- research focus: trajectory inference
- research focus: cell-cell communication
- research focus: dimensionality reduction
- approach: deep learning
- approach: transformer / foundation model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Fast, Efficient, and Accurate Neuro-Imaging Denoising via Deep Learning
Shivesh Chaudhary, Sihoon Moon, Hang Lu·bioRxiv·Apr 13, 2022
- Automated long-term recording and analysis of neural activity in behaving animals
Ashesh K Dhawale, Rajesh Poddar, … Bence Olveczky·bioRxiv·Jan 24, 2016
- A unified open-source platform for multimodal neural recording and perturbation during naturalistic behavior
Jonathan P. Newman, Jie J. Zhang, … Jakob Voigts·bioRxiv·Aug 30, 2023
- End-to-end multimodal deep learning for real-time decoding of months-long neural activity from the same cells
Yichun He, Arnau Marin‐Llobet, … Jia Liu B·bioRxiv·Oct 14, 2024
- Behavioral clusters revealed by end-to-end decoding from microendoscopic imaging
Chia-Jung Chang, Wei Guo, … Matt Wilson·bioRxiv·Apr 15, 2021
- Chronic wireless streaming of invasive neural recordings at home for circuit discovery and adaptive stimulation
Ro’ee Gilron, Simon J Little, … Philip A. Starr·bioRxiv·Feb 13, 2020