A wholistic view of continual learning with deep neural networks: forgotten lessons and the bridge to active and open world learning
- Current deep learning methods are regarded as favorable if they empirically perform well on dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual learning, where consecutively arriving data is investigated. The core challenge is framed as protecting previously acquired representations from being catastrophically forgotten. However, comparison of individual methods is nevertheless performed in isolation from the real world by monitoring accumulated benchmark test set performance. The closed world assumption remains predominant, i.e. models are evaluated on data that is guaranteed to originate from the same distribution as used for training. This poses a massive challenge as neural networks are well known to provide overconfident false predictions on unknown and corrupted instances. In this work we critically survey the literature and argue that notable lessons from open set recognition, identifying unknown examples outside of the observed set, and the adjacent field of active learning, querying data to maximize the expected performance gain, are frequently overlooked in the deep learning era. Hence, we propose a consolidated view to bridge continual learning, active learning and open set recognition in deep neural networks. Finally, the established synergies are supported empirically, showing joint improvement in alleviating catastrophic forgetting, querying data, selecting task orders, while exhibiting robust open world application.
Author: | Martin MundtORCiDGND, Yongwon HongORCiD, Iuliia PliushchGND, Visvanathan RameshORCiD |
---|---|
URN: | urn:nbn:de:hebis:30:3-788552 |
DOI: | https://doi.org/10.1016/j.neunet.2023.01.014 |
ISSN: | 0893-6080 |
Parent Title (English): | Neural networks |
Publisher: | Elsevier |
Place of publication: | Amsterdam |
Document Type: | Article |
Language: | English |
Date of Publication (online): | 2023/10/30 |
Date of first Publication: | 2023/10/20 |
Publishing Institution: | Universitätsbibliothek Johann Christian Senckenberg |
Release Date: | 2024/03/04 |
Tag: | Active learning; Continual deep learning; Lifelong machine learning; Open set recognition; Open world learning |
Volume: | 160 |
Page Number: | 31 |
First Page: | 306 |
Last Page: | 336 |
Institutes: | Psychologie und Sportwissenschaften / Psychologie |
Informatik und Mathematik / Informatik | |
Dewey Decimal Classification: | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
3 Sozialwissenschaften / 37 Bildung und Erziehung / 370 Bildung und Erziehung | |
Sammlungen: | Universitätspublikationen |
Licence (German): | Creative Commons - Namensnennung 4.0 |