A comparison of measures to validate scales in voting advice applications

  • Voting advice applications (VAAs) are online tools providing voting advice to their users. This voting advice is based on the match between the answers of the user and the answers of several political parties to a common questionnaire on political attitudes. To visualize this match, VAAs use a wide array of visualisations, most popular of which are the two-dimensional political maps. These maps show the position of both the political parties and the user in the political landscape, allowing the user to understand both their own position and their relation to the political parties. To construct these maps, VAAs require scales that represent the main underlying dimensions of the political space. This makes the correct construction of these scales important if the VAA aims to provide accurate and helpful voting advice. This paper presents three criteria that assess if a VAA achieves this aim. To illustrate their usefulness, these three criteria—unidimensionality, reliability and quality—are used to assess the scales in the cross-national EUVox VAA, a VAA designed for the European Parliament elections of 2014. Using techniques from Mokken scaling analysis and categorical principal component analysis to capture the metrics, I find that most scales show low unidimensionality and reliability. Moreover, even while designers can—and sometimes do—use certain techniques to improve their scales, these improvements are rarely enough to overcome all of the problems regarding unidimensionality, reliability and quality. This leaves certain problems for the designers of VAAs and designers of similar type online surveys.

Download full text files

Export metadata

Metadaten
Author:Bastiaan BruinsmaORCiD
URN:urn:nbn:de:hebis:30:3-812958
DOI:https://doi.org/10.1007/s11135-020-00986-8
ISSN:1573-7845
Parent Title (English):Quality & quantity
Publisher:Springer Science + Business Media B.V
Place of publication:Dordrecht [u.a.]
Document Type:Article
Language:English
Date of Publication (online):2020/04/29
Date of first Publication:2020/04/29
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2024/02/28
Tag:Data quality; Scales; Voting advice applications
Volume:54
Issue:4
Page Number:18
First Page:1299
Last Page:1316
Note:
Open Access funding provided by Projekt DEAL.
HeBIS-PPN:520349334
Institutes:Gesellschaftswissenschaften
Dewey Decimal Classification:3 Sozialwissenschaften / 32 Politikwissenschaft / 320 Politikwissenschaft
Sammlungen:Universitätspublikationen
Licence (German):License LogoCreative Commons - CC BY - Namensnennung 4.0 International