Unveiling functions of the visual cortex using task-specific deep neural networks
- The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.
Author: | Kshitij DwivediORCiDGND, Michael F. BonnerORCiD, Radoslaw Martin CichyORCiDGND, Gemma Roig NogueraORCiDGND |
---|---|
URN: | urn:nbn:de:hebis:30:3-729017 |
DOI: | https://doi.org/10.1101/2020.11.27.401380 |
Parent Title (English): | bioRxiv |
Document Type: | Preprint |
Language: | English |
Date of Publication (online): | 2021/06/23 |
Date of first Publication: | 2021/06/23 |
Publishing Institution: | Universitätsbibliothek Johann Christian Senckenberg |
Release Date: | 2023/03/27 |
Issue: | 2020.11.27.401380 |
Page Number: | 40 |
HeBIS-PPN: | 506728595 |
Institutes: | Informatik und Mathematik / Informatik |
Dewey Decimal Classification: | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit | |
Sammlungen: | Universitätspublikationen |
Licence (German): | Creative Commons - CC BY-NC - Namensnennung - Nicht kommerziell 4.0 International |