Criticality meets learning : criticality signatures in a self-organizing recurrent neural network

  • Many experiments have suggested that the brain operates close to a critical state, based on signatures of criticality such as power-law distributed neuronal avalanches. In neural network models, criticality is a dynamical state that maximizes information processing capacities, e.g. sensitivity to input, dynamical range and storage capacity, which makes it a favorable candidate state for brain function. Although models that self-organize towards a critical state have been proposed, the relation between criticality signatures and learning is still unclear. Here, we investigate signatures of criticality in a self-organizing recurrent neural network (SORN). Investigating criticality in the SORN is of particular interest because it has not been developed to show criticality. Instead, the SORN has been shown to exhibit spatio-temporal pattern learning through a combination of neural plasticity mechanisms and it reproduces a number of biological findings on neural variability and the statistics and fluctuations of synaptic efficacies. We show that, after a transient, the SORN spontaneously self-organizes into a dynamical state that shows criticality signatures comparable to those found in experiments. The plasticity mechanisms are necessary to attain that dynamical state, but not to maintain it. Furthermore, onset of external input transiently changes the slope of the avalanche distributions – matching recent experimental findings. Interestingly, the membrane noise level necessary for the occurrence of the criticality signatures reduces the model’s performance in simple learning tasks. Overall, our work shows that the biologically inspired plasticity and homeostasis mechanisms responsible for the SORN’s spatio-temporal learning abilities can give rise to criticality signatures in its activity when driven by random input, but these break down under the structured input of short repeating sequences.
Metadaten
Author:Bruno del Papa, Viola PriesemannORCiDGND, Jochen TrieschORCiD
URN:urn:nbn:de:hebis:30:3-440510
DOI:https://doi.org/10.1371/journal.pone.0178683
ISSN:1932-6203
Parent Title (English):PLoS one
Publisher:PLoS
Place of publication:Lawrence, Kan.
Contributor(s):Dante R. Chialvo
Document Type:Article
Language:English
Date of Publication (online):2017/05/29
Date of first Publication:2017/05/26
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2017/05/29
Volume:12
Issue:(5): e0178683
Page Number:21
First Page:1
Last Page:21
Note:
Copyright: © 2017 Del Papa et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
HeBIS-PPN:415180430
Institutes:Physik / Physik
Wissenschaftliche Zentren und koordinierte Programme / Frankfurt Institute for Advanced Studies (FIAS)
Angeschlossene und kooperierende Institutionen / MPI für Hirnforschung
Dewey Decimal Classification:6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit
Sammlungen:Universitätspublikationen
Licence (German):License LogoCreative Commons - Namensnennung 4.0