Autonomous development of active binocular and motion vision through active efficient coding
- We present a model for the autonomous and simultaneous learning of active binocular and motion vision. The model is based on the Active Efficient Coding (AEC) framework, a recent generalization of classic efficient coding theories to active perception. The model learns how to efficiently encode the incoming visual signals generated by an object moving in 3-D through sparse coding. Simultaneously, it learns how to produce eye movements that further improve the efficiency of the sensory coding. This learning is driven by an intrinsic motivation to maximize the system's coding efficiency. We test our approach on the humanoid robot iCub using simulations. The model demonstrates self-calibration of accurate object fixation and tracking of moving objects. Our results show that the model keeps improving until it hits physical constraints such as camera or motor resolution, or limits on its internal coding capacity. Furthermore, we show that the emerging sensory tuning properties are in line with results on disparity, motion, and motion-in-depth tuning in the visual cortex of mammals. The model suggests that vergence and tracking eye movements can be viewed as fundamentally having the same objective of maximizing the coding efficiency of the visual system and that they can be learned and calibrated jointly through AEC.
Verfasserangaben: | Alexander LelaisORCiD, Jonas Mahn, Vikram Narayan, Chong Zhang, Bertram E. ShiORCiD, Jochen TrieschORCiD |
---|---|
URN: | urn:nbn:de:hebis:30:3-507561 |
DOI: | https://doi.org/10.3389/fnbot.2019.00049 |
ISSN: | 1662-5218 |
Pubmed-Id: | https://pubmed.ncbi.nlm.nih.gov/31379548 |
Titel des übergeordneten Werkes (Englisch): | Frontiers in neurorobotics |
Verlag: | Frontiers Research Foundation |
Verlagsort: | Lausanne |
Sonstige beteiligte Person(en): | Florian Röhrbein |
Dokumentart: | Wissenschaftlicher Artikel |
Sprache: | Englisch |
Jahr der Fertigstellung: | 2019 |
Datum der Erstveröffentlichung: | 16.07.2019 |
Veröffentlichende Institution: | Universitätsbibliothek Johann Christian Senckenberg |
Datum der Freischaltung: | 19.08.2019 |
Freies Schlagwort / Tag: | active perception; autonomous learning; binocular vision; efficient coding; intrinsic motivation; optokinetic nystagmus; smooth pursuit |
Jahrgang: | 13 |
Ausgabe / Heft: | Art. 49 |
Seitenzahl: | 14 |
Erste Seite: | 1 |
Letzte Seite: | 14 |
Bemerkung: | Copyright © 2019 Lelais, Mahn, Narayan, Zhang, Shi and Triesch. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
HeBIS-PPN: | 45400737X |
Institute: | Physik / Physik |
Wissenschaftliche Zentren und koordinierte Programme / Frankfurt Institute for Advanced Studies (FIAS) | |
DDC-Klassifikation: | 5 Naturwissenschaften und Mathematik / 53 Physik / 530 Physik |
Sammlungen: | Universitätspublikationen |
Lizenz (Deutsch): | Creative Commons - Namensnennung 4.0 |