Unveiling functions of the visual cortex using task-specific deep neural networks

  • The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Author:Kshitij DwivediORCiDGND, Michael F. BonnerORCiD, Radoslaw Martin CichyORCiDGND, Gemma Roig NogueraORCiDGND
Parent Title (English):bioRxiv
Document Type:Preprint
Date of Publication (online):2021/06/23
Date of first Publication:2021/06/23
Publishing Institution:Universit├Ątsbibliothek Johann Christian Senckenberg
Release Date:2023/03/27
Page Number:40
Institutes:Informatik und Mathematik / Informatik
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit
Licence (German):License LogoCreative Commons - CC BY-NC - Namensnennung - Nicht kommerziell 4.0 International