Towards a dependency-oriented evaluation for partial parsing

Quantitative evaluation of parsers has traditionally centered around the PARSEVAL measures of crossing brackets, (labeled) precision, and (labeled) recall. However, it is well known that these measures do not give an acc
Quantitative evaluation of parsers has traditionally centered around the PARSEVAL measures of crossing brackets, (labeled) precision, and (labeled) recall. However, it is well known that these measures do not give an accurate picture of the quality of the parsers output. Furthermore, we will show that they are especially unsuited for partial parsers. In recent years, research has concentrated on dependencybased evaluation measures. We will show in this paper that such a dependency-based evaluation scheme is particularly suitable for partial parsers. TüBa-D, the treebank used here for evaluation, contains all the necessary dependency information so that the conversion of trees into a dependency structure does not have to rely on heuristics. Therefore, the dependency representations are not only reliable, they are also linguistically motivated and can be used for linguistic purposes.
show moreshow less

Export metadata

  • Export Bibtex
  • Export RIS

Additional Services

    Share in Twitter Search Google Scholar
Metadaten
Author:Sandra Kübler, Heike Telljohann
URN:urn:nbn:de:hebis:30-1111289
Document Type:Article
Language:English
Date of Publication (online):2008/11/03
Year of first Publication:2002
Publishing Institution:Univ.-Bibliothek Frankfurt am Main
Release Date:2008/11/03
Source:http://jones.ling.indiana.edu/~skuebler/papers/lrec_ws02.ps ; Proceedings of Beyond PARSEVAL -- Towards Improved Evaluation Measures for Parsing Systems (LREC 2002 Workshop) - Las Palmas, Gran Canaria, June 2002.
HeBIS PPN:206936923
Dewey Decimal Classification:400 Sprache
Sammlungen:Linguistik
Linguistic-Classification:Linguistik-Klassifikation: Computerlinguistik / Computational linguistics
Licence (German):License Logo Veröffentlichungsvertrag für Publikationen

$Rev: 11761 $