Towards a dependency-oriented evaluation for partial parsing

  • Quantitative evaluation of parsers has traditionally centered around the PARSEVAL measures of crossing brackets, (labeled) precision, and (labeled) recall. However, it is well known that these measures do not give an accurate picture of the quality of the parsers output. Furthermore, we will show that they are especially unsuited for partial parsers. In recent years, research has concentrated on dependencybased evaluation measures. We will show in this paper that such a dependency-based evaluation scheme is particularly suitable for partial parsers. TüBa-D, the treebank used here for evaluation, contains all the necessary dependency information so that the conversion of trees into a dependency structure does not have to rely on heuristics. Therefore, the dependency representations are not only reliable, they are also linguistically motivated and can be used for linguistic purposes.
Author:Sandra KüblerORCiDGND, Heike Telljohann
Editor:John Carroll, Anette Frank, Dekang Lin, Detlef Prescher, Hans Uszkoreit
Document Type:Preprint
Year of Completion:2002
Year of first Publication:2002
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2008/11/03
Page Number:8
Erschienen in: John Carroll ; Anette Frank ; Dekang Lin ; Detlef Prescher ; Hans Uszkoreit (Hrsg.): Beyond PARSEVAL - Towards Improved Evaluation Measures for Parsing Systems. Workshop at the 3rd International Conference on Language Resources and Evaluation (LREC-02), Las Palmas, Gran Canaria, Spain, 2002, S. 9-16
Source: ; Proceedings of Beyond PARSEVAL -- Towards Improved Evaluation Measures for Parsing Systems (LREC 2002 Workshop) - Las Palmas, Gran Canaria, June 2002.
Institutes:keine Angabe Fachbereich / Extern
Dewey Decimal Classification:4 Sprache / 40 Sprache / 400 Sprache
Linguistik-Klassifikation:Linguistik-Klassifikation: Computerlinguistik / Computational linguistics
Licence (German):License LogoDeutsches Urheberrecht