Preference inversion in discrete choice experiments

A novel test of the emoji scale

Bibliographic Data

ID5657952
AuthorsThao Thai (0000-0002-0995-7509, Monash University), Lidia Engel (0000-0002-7959-3149, Monash University), Jemimah Ride (0000-0002-1820-5499, Monash University), B Mulhern (0000-0003-3656-8063, University of Technology Sydney), Richard Norman (0000-0002-3112-3893, Curtin University), Cathrine Mihalopoulos (0000-0002-7127-9462, Monash University)
Year2025
Volume386
Pages118661
Publication date2025-12-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSocial Science & Medicine (JOURNAL)
Journal identifiersISSN: 0277-9536 • E-ISSN: 1873-5347
PublisherElsevier BV (PUBLISHER)
DOI10.1016/j.socscimed.2025.118661
PMID41101175
OpenAlexW4415080613
LanguageEN
References cited42

Preference inversion - where preference estimates do not align with the hierarchical order of attribute levels-remains a concern in health valuation studies. To address this, we developed a novel visual aid, the emoji scale, comprising five Apple Unicode emoji characters to represent five levels of a health-related quality-of-life measure. Using a case study of the Recovering Quality of Life - Utility index instrument, we explored whether the emoji scale could reduce preference inversion and improve respondent experience in discrete choice experiments (DCEs). We conducted a between-respondent comparison involving 2024 Australian adults, randomly allocated to one of four arms:(1) standard text-only choice tasks, (2) emoji & text (combined), (3) emoji-only (no text), and (4) text with purple colour-coding. We estimated value sets derived from each format and assessed differences in perceived task difficulty, engagement, and preference inversion using t-tests and model comparisons. Results showed that utility decrements from the emoji & text were closely aligned with those from the standard text-only format. Importantly, the emoji & text reduced preference inversion and was associated with lower reported task difficulty and higher engagement compared to other formats. These findings suggest that pairing emojis with text may enhance respondent understanding and data quality in health valuation tasks, without compromising the validity of the resulting value sets. While further work is necessary to fully understand the legitimacy of the emoji scale as an effective visual aid for conveying attribute level ordering, the emoji & text format offers a promising approach to improving DCEs

Digital Communication and Language · Language, Discourse, Communication Strategies · Multisensory perception and integration