How and what can humans learn from being in the loop? : Invoking contradiction learning as a measure to make humans smarter

  • This article discusses the counterpart of interactive machine learning, i.e., human learning while being in the loop in a human-machine collaboration. For such cases we propose the use of a Contradiction Matrix to assess the overlap and the contradictions of human and machine predictions. We show in a small-scaled user study with experts in the area of pneumology (1) that machine-learning based systems can classify X-rays with respect to diseases with a meaningful accuracy, (2) humans partly use contradictions to reconsider their initial diagnosis, and (3) that this leads to a higher overlap between human and machine diagnoses at the end of the collaboration situation. We argue that disclosure of information on diagnosis uncertainty can be beneficial to make the human expert reconsider her or his initial assessment which may ultimately result in a deliberate agreement. In the light of the observations from our project, it becomes apparent that collaborative learning in such a human-in-the-loop scenario could lead to mutual benefits for both human learning and interactive machine learning. Bearing the differences in reasoning and learning processes of humans and intelligent systems in mind, we argue that interdisciplinary research teams have the best chances at tackling this undertaking and generating valuable insights.

Download full text files

Export metadata

Author:Benjamin M. Abdel‑Karim, Nicolas PfeufferORCiDGND, Gernot Gerhard Ulrich RohdeORCiDGND, Oliver HinzORCiDGND
Parent Title (English):KI - Künstliche Intelligenz
Place of publication:Berlin ; Heidelberg
Document Type:Article
Date of Publication (online):2020/01/22
Date of first Publication:2020/01/22
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2020/09/15
Tag:Experts; Feedback loop; Machine learning; Machine teaching
Page Number:9
First Page:199
Last Page:207
Institutes:Wirtschaftswissenschaften / Wirtschaftswissenschaften
Medizin / Medizin
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
3 Sozialwissenschaften / 37 Bildung und Erziehung / 370 Bildung und Erziehung
Licence (German):License LogoCreative Commons - Namensnennung 4.0