Towards a dependency-oriented evaluation for partial parsing

  • Quantitative evaluation of parsers has traditionally centered around the PARSEVAL measures of crossing brackets, (labeled) precision, and (labeled) recall. However, it is well known that these measures do not give an accurate picture of the quality of the parsers output. Furthermore, we will show that they are especially unsuited for partial parsers. In recent years, research has concentrated on dependencybased evaluation measures. We will show in this paper that such a dependency-based evaluation scheme is particularly suitable for partial parsers. TüBa-D, the treebank used here for evaluation, contains all the necessary dependency information so that the conversion of trees into a dependency structure does not have to rely on heuristics. Therefore, the dependency representations are not only reliable, they are also linguistically motivated and can be used for linguistic purposes.
Metadaten
Author:Sandra KüblerORCiDGND, Heike Telljohann
URN:urn:nbn:de:hebis:30-1111289
URL:http://cl.indiana.edu/~skuebler/papers/lrec_ws02.ps
Editor:John Carroll, Anette Frank, Dekang Lin, Detlef Prescher, Hans Uszkoreit
Document Type:Preprint
Language:English
Year of Completion:2002
Year of first Publication:2002
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2008/11/03
Page Number:8
Note:
Erschienen in: John Carroll ; Anette Frank ; Dekang Lin ; Detlef Prescher ; Hans Uszkoreit (Hrsg.): Beyond PARSEVAL - Towards Improved Evaluation Measures for Parsing Systems. Workshop at the 3rd International Conference on Language Resources and Evaluation (LREC-02), Las Palmas, Gran Canaria, Spain, 2002, S. 9-16
Source:http://jones.ling.indiana.edu/~skuebler/papers/lrec_ws02.ps ; Proceedings of Beyond PARSEVAL -- Towards Improved Evaluation Measures for Parsing Systems (LREC 2002 Workshop) - Las Palmas, Gran Canaria, June 2002.
HeBIS-PPN:206936923
Institutes:keine Angabe Fachbereich / Extern
Dewey Decimal Classification:4 Sprache / 40 Sprache / 400 Sprache
Sammlungen:Linguistik
Linguistik-Klassifikation:Linguistik-Klassifikation: Computerlinguistik / Computational linguistics
Licence (German):License LogoDeutsches Urheberrecht

OPUS4 Logo