An HPSG approach to synchronous speech and deixis
- The use of hand gestures to point at objects and individuals, or to navigate through landmarks on a virtually created map is ubiquitous in face-to-face conversation. We take this observation as a starting point, and we demonstrate that deictic gestures can be analysed on a par with speech by using standard methods from constraint-based grammars such as HPSG. In particular, we use the form of the deictic signal, the form of the speech signal (including its prosodic marking) and their relative temporal performance to derive an integrated multimodal tree that maps to an integrated multimodal meaning. The integration process is constrained via construction rules that rule out ill-formed input. These rules are driven from an empirical corporal study which sheds light on the interaction between speech and deictic gesture.
Download full text files
Additional Services
| Author: | Katya AlahverdzhievaORCiD, Alex LascaridesORCiDGND |
|---|---|
| URN: | urn:nbn:de:hebis:30:3-715229 |
| DOI: | https://doi.org/10.21248/hpsg.2011.1 |
| ISSN: | 1535-1793 |
| Parent Title (English): | Proceedings of the ... International Conference on Head-Driven Phrase Structure Grammar (HPSG) |
| Publisher: | CSLI Publications |
| Place of publication: | Stanford, CA |
| Document Type: | Conference Proceeding |
| Language: | English |
| Date of Publication (online): | 2011/11/16 |
| Year of first Publication: | 2011 |
| Publishing Institution: | Universitätsbibliothek Johann Christian Senckenberg |
| Contributing Corporation: | International Conference on Head Driven Phrase Structure Grammar (18 : 2011 : Seattle, Wash.) |
| Release Date: | 2024/09/06 |
| GND Keyword: | Deixis; Gestik; Multimodalität |
| Volume: | 18.2011 |
| Page Number: | 19 |
| First Page: | 6 |
| Last Page: | 24 |
| Dewey Decimal Classification: | 4 Sprache / 40 Sprache / 400 Sprache |
| 4 Sprache / 41 Linguistik / 410 Linguistik | |
| 4 Sprache / 42 Englisch, Altenglisch / 420 Englisch, Altenglisch | |
| Sammlungen: | Linguistik |
| Linguistik-Klassifikation: | Linguistik-Klassifikation: Nonverbale Kommunikation / Non-verbal communication |
| Licence (German): |  Creative Commons - CC BY - Namensnennung 4.0 International |
