Quantifying information modification in developing neural networks via partial information decomposition

  • Information processing performed by any system can be conceptually decomposed into the transfer, storage and modification of information—an idea dating all the way back to the work of Alan Turing. However, formal information theoretic definitions until very recently were only available for information transfer and storage, not for modification. This has changed with the extension of Shannon information theory via the decomposition of the mutual information between inputs to and the output of a process into unique, shared and synergistic contributions from the inputs, called a partial information decomposition (PID). The synergistic contribution in particular has been identified as the basis for a definition of information modification. We here review the requirements for a functional definition of information modification in neuroscience, and apply a recently proposed measure of information modification to investigate the developmental trajectory of information modification in a culture of neurons vitro, using partial information decomposition. We found that modification rose with maturation, but ultimately collapsed when redundant information among neurons took over. This indicates that this particular developing neural system initially developed intricate processing capabilities, but ultimately displayed information processing that was highly similar across neurons, possibly due to a lack of external inputs. We close by pointing out the enormous promise PID and the analysis of information modification hold for the understanding of neural systems

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Author:Michael WibralORCiDGND, Conor Finn, Patricia Wollstadt, Joseph T. Lizier, Viola PriesemannORCiDGND
Parent Title (English):Entropy
Document Type:Article
Date of Publication (online):2017/09/14
Date of first Publication:2017/09/14
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2019/10/22
Tag:information theory; neural computation; neural development; partial information decomposition; self-organisation
© 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Institutes:Medizin / Medizin
Angeschlossene und kooperierende Institutionen / MPI für Hirnforschung
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie
6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit
Licence (German):License LogoCreative Commons - Namensnennung 4.0