When specialization helps: using pooled contextualized embeddings to detect chemical and biomedical entities in Spanish
- The recognition of pharmacological substances, compounds and proteins is an essential preliminary work for the recognition of relations between chemicals and other biomedically relevant units. In this paper, we describe an approach to Task 1 of the PharmaCoNER Challenge, which involves the recognition of mentions of chemicals and drugs in Spanish medical texts. We train a state-of-the-art BiLSTM-CRF sequence tagger with stacked Pooled Contextualized Embeddings, word and sub-word embeddings using the open-source framework FLAIR. We present a new corpus composed of articles and papers from Spanish health science journals, termed the Spanish Health Corpus, and use it to train domain-specific embeddings which we incorporate in our model training. We achieve a result of 89.76% F1-score using pre-trained embeddings and are able to improve these results to 90.52% F1-score using specialized embeddings.
Download full text files
Additional Services
| Author: | Manuel Stoeckel, Wahed HematiGND, Alexander MehlerORCiDGND |
|---|---|
| URN: | urn:nbn:de:hebis:30:3-593524 |
| URL: | https://aclanthology.org/D19-5702/ |
| DOI: | https://doi.org/10.18653/v1/D19-5702 |
| Parent Title (German): | Proceedings of The 5th Workshop on BioNLP Open Shared Tasks, Hong Kong |
| Publisher: | Association for Computational Linguistics |
| Place of publication: | [Erscheinungsort nicht ermittelbar] |
| Document Type: | Conference Proceeding |
| Language: | English |
| Year of Completion: | 2019 |
| Year of first Publication: | 2019 |
| Publishing Institution: | Universitätsbibliothek Johann Christian Senckenberg |
| Release Date: | 2022/05/12 |
| Page Number: | 5 |
| First Page: | 11 |
| Last Page: | 15 |
| HeBIS-PPN: | 495514403 |
| Institutes: | Informatik und Mathematik |
| Dewey Decimal Classification: | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
| 4 Sprache / 46 Spanisch, Portugiesisch / 460 Spanisch, Portugiesisch | |
| Sammlungen: | Universitätspublikationen |
| Licence (English): |  Creative Commons - Namensnennung-Nicht kommerziell 4.0 |
