Sign in
NeurosciencebioRxiv
Preprint

Human-like sequential sound-to-meaning transfer drives artificial speech comprehension

Shenshen Zhang, Siqi Li, Ruolin YangiD, Guanpeng CheniD, Xing TianiD, Qian WangiD, Fang FangiD

Abstract

Artificial intelligence has reached a pivotal threshold. Multimodal large models can approach human-level speech comprehension by rapidly transforming sound into meaning. However, whether this process relies on human-like mechanisms remains unknown. Here, we compared the human brain with twelve speech language models (SLMs) using a phonology-semantics confusion paradigm. Stereo-electroencephalography revealed two mechanisms of phonology-to-semantics (P2S) transfer in the human brain: a local sequential transformation within specific neuronal populations, and a global cross-regional hierarchy of P2S representations. Only brain-model alignment in the local sequential manner predicted model performance. Correspondingly, targeted lesioning of local sequential P2S-transfer model units markedly impaired comprehension performance, while activation steering of these units improved performance. In addition, such local sequential P2S-transfer model units were identified across languages. Together, this study establishes local sequential P2S transformation as a fundamental computational principle shared across biological and artificial intelligence, offering a mechanistic bridge for future brain-inspired speech systems.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISKeshishian '26Yang '26Cai '25Anderson '23Martorell '26Wingfield '22
72% semantic matchNeuroscience
Menoua Keshishian, Gavin Mischler, Samuel Thomas+4 more·Nature Machine Intelligence·Feb 17, 2026· 5 citations