CRFVoter : gene and protein related object recognition using a conglomerate of CRF-based tools
- Background: Gene and protein related objects are an important class of entities in biomedical research, whose identification and extraction from scientific articles is attracting increasing interest. In this work, we describe an approach to the BioCreative V.5 challenge regarding the recognition and classification of gene and protein related objects. For this purpose, we transform the task as posed by BioCreative V.5 into a sequence labeling problem. We present a series of sequence labeling systems that we used and adapted in our experiments for solving this task. Our experiments show how to optimize the hyperparameters of the classifiers involved. To this end, we utilize various algorithms for hyperparameter optimization. Finally, we present CRFVoter, a two-stage application of Conditional Random Field (CRF) that integrates the optimized sequence labelers from our study into one ensemble classifier. Results: We analyze the impact of hyperparameter optimization regarding named entity recognition in biomedical research and show that this optimization results in a performance increase of up to 60%. In our evaluation, our ensemble classifier based on multiple sequence labelers, called CRFVoter, outperforms each individual extractor’s performance. For the blinded test set provided by the BioCreative organizers, CRFVoter achieves an F-score of 75%, a recall of 71% and a precision of 80%. For the GPRO type 1 evaluation, CRFVoter achieves an F-Score of 73%, a recall of 70% and achieved the best precision (77%) among all task participants. Conclusion: CRFVoter is effective when multiple sequence labeling systems are to be used and performs better then the individual systems collected by it.
Author: | Wahed Hemati, Alexander MehlerORCiDGND |
---|---|
URN: | urn:nbn:de:hebis:30:3-488331 |
DOI: | https://doi.org/10.1186/s13321-019-0343-x |
ISSN: | 1758-2946 |
Pubmed Id: | https://pubmed.ncbi.nlm.nih.gov/30874918 |
Parent Title (English): | Journal of cheminformatics |
Publisher: | BioMed Central |
Place of publication: | London |
Document Type: | Article |
Language: | English |
Year of Completion: | 2019 |
Date of first Publication: | 2019/03/14 |
Publishing Institution: | Universitätsbibliothek Johann Christian Senckenberg |
Release Date: | 2019/04/04 |
Tag: | BioCreative V.5; BioNLP; Biomedical named entity recognition; CRF; GPRO; Machine learning; Named entity recognition |
Volume: | 11 |
Issue: | 1, Art. 21 |
Page Number: | 11 |
First Page: | 1 |
Last Page: | 11 |
Note: | Open Access: This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. |
HeBIS-PPN: | 450808297 |
Institutes: | Informatik und Mathematik / Informatik |
Dewey Decimal Classification: | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit | |
Sammlungen: | Universitätspublikationen |
Open-Access-Publikationsfonds: | Informatik und Mathematik |
Licence (German): | Creative Commons - Namensnennung 4.0 |