Obstacles to inferring mechanistic similarity using Representational Similarity Analysis
- Representational Similarity Analysis (RSA) is an innovative approach used to compare neural representations across individuals, species and computational models. Despite its popularity within neuroscience, psychology and artificial intelligence, this approach has led to difficult-to-reconcile and contradictory findings, particularly when comparing primate visual representations with deep neural networks (DNNs). Here, we demonstrate how such contradictory findings could arise due to incorrect inferences about mechanism when comparing complex systems processing high-dimensional stimuli. In a series of studies comparing computational models, primate cortex and human cortex we find two problematic phenomena: a “mimic effect”, where confounds in stimuli can lead to high RSA-scores between provably dissimilar systems, and a “modulation effect”, where RSA- scores become dependent on stimuli used for testing. Since our results bear on a number of influential findings, we provide recommendations to avoid these pitfalls and sketch a way forward to a more solid science of representation in cognitive systems.
Author: | Marin DujmovićORCiD, Jeffrey S. BowersORCiDGND, Federico AdolfiORCiD, Gaurav MalhotraORCiD |
---|---|
URN: | urn:nbn:de:hebis:30:3-751181 |
URL: | https://www.biorxiv.org/content/10.1101/2022.04.05.487135v4 |
DOI: | https://doi.org/10.1101/2022.04.05.487135 |
Parent Title (German): | bioRxiv |
Document Type: | Preprint |
Language: | English |
Date of Publication (online): | 2023/05/01 |
Date of first Publication: | 2023/05/01 |
Publishing Institution: | Universitätsbibliothek Johann Christian Senckenberg |
Release Date: | 2023/09/01 |
Issue: | 2022.04.05.487135 Version 4 |
Edition: | Version 4 |
Page Number: | 48 |
HeBIS-PPN: | 511591802 |
Dewey Decimal Classification: | 1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie |
Sammlungen: | Universitätspublikationen |
Licence (German): | Creative Commons - CC BY-NC - Namensnennung - Nicht kommerziell 4.0 International |