Predicting Individual Task Contrasts From Resting-state Functional Connectivity using a Surface-based Convolutional Network

Abstract

Task-based and resting-state represent the two most common experimental paradigms of functional neuroimaging. While resting-state offers a flexible and scalable approach for characterizing brain function, task-based techniques provide superior localization. In this paper, we build on recent deep learning methods to create a model that predicts task-based contrast maps from resting-state fMRI scans. Specifically, we propose BrainSurfCNN, a surface-based fully-convolutional neural network model that works with a representation of the brains cortical sheet. Our model achieves state of the art predictive accuracy on independent test data from the Human Connectome Project and yields individual-level predicted maps that are on par with the target-repeat reliability of the measured contrast maps. We also demonstrate that BrainSurfCNN can generalize remarkably well to novel domains with limited training data.