Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

How Valid Are Trust Survey Measures? New Insights From Open-Ended Probing Data and Supervised Machine Learning

Bibliographic Data

ID2331176
AuthorsCamille Landesvatter (0000-0003-0156-5364, Mannheim Centre for European Social Research, University of Mannheim, Mannheim, Baden-Württemberg, Germany, corresponding author), Paul C Bauer (0000-0002-8382-9724, University of Freiburg, corresponding author)
Year2025
Volume54
Issue2
Pages534-564
Publication date2025-05-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSociological Methods & Research (JOURNAL)
Journal identifiersISSN: 0049-1241 • E-ISSN: 1552-8294
PublisherSAGE Publications Inc (PUBLISHER)
DOI10.1177/00491241241234871
OpenAlexW4393041870
LanguageEN
Citations received6
References cited54

Trust is a foundational concept of contemporary sociological theory. Still, empirical research on trust relies on a relatively small set of measures. These are increasingly debated, potentially undermining large swathes of empirical evidence. Drawing on a combination of open-ended probing data, supervised machine learning, and a U.S. representative quota sample, our study compares the validity of standard measures of generalized social trust with more recent, situation-specific measures of trust. We find that survey measures that refer to 'strangers' in their question wording best reflect the concept of generalized trust, also known as trust in unknown others. While situation-specific measures should have the desirable property of further reducing variation in associations, that is, producing more similar frames of reference across respondents, they also seem to increase associations with known others, which is undesirable. In addition, we explore to what extent trust survey questions may evoke negative associations. We find that there is indeed variation across measures, which calls for more research

Data science · Machine learning · Mathematics education · Supervised Learning · Artificial Intelligence · Computer Science · Electoral Systems and Political Participation · Psychology · Social Capital and Networks

  • Measuring particularized trust

    Open Access•B G Robbins•Social Networks•2023

  • Generative AI Meets Open-Ended Survey Responses

    Open Access•Simone Zhang, Janet Xu et al.•Sociological Methods & Research•2025

  • Generalized Trust and Support for Immigrant Rights in Japan

    Open Access•Guangyu Liang•Japanese Journal of Sociology•2026

  • SOCbot

    Open Access•Patrick Sturgis, Thomas Robinson et al.•Sociological Methods & Research•2026

  • Achieving practical trust in the context of interpersonal vulnerability

    Open Access•Ann Merrit Rikke Nielsen, Mie Femø Nielsen et al.•Journal of Trust Research•2025

  • The Influence of Rating Scales and Question Attributes on the Validity and Reliability of Generalized Trust Scales

    Open Access•B G Robbins•Social Indicators Research•2024

  • Cross-Cultural Differences in Relationship- and Group-Based Trust

    Open Access•M Yuki, William W Maddux et al.•Personality and Social Psychology…•2005

  • Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and Covariance

    Open Access•Gene V Gla, Gene V Glass et al.•Review of Educational Research•1972

  • Ten Common Misunderstandings, Misconceptions, Persistent Myths and Urban Legends about Likert Scales and Likert Response Formats and their Antidotes

    Open Access•James Carifio, Rocco J Perla•Journal of Social Sciences•2007

  • Prolific.ac—A subject pool for online experiments

    Open Access•Stefan Palan, Christian Schitter•Journal of Behavioral and…•2018

  • Trust and commitment in the United States and Japan

    Open Access•Toshio Yamagishi, Midori Yamagishi•Motivation and Emotion•1994

  • Does Travel Broaden the Mind? Breadth of Foreign Experiences Increases Generalized Trust

    Open Access•Jiyin Cao, Adam D Galinsky et al.•Social Psychological and…•2014

  • The Rise and Fall of Social Cohesion

    Open Access•Christian Albrekt Larsen•The Rise And Fall Of Social…•2013

  • The Problem of Forming Social Capital

    Open Access•Francisco Herreros•Problem of Forming Social Capital•2004

  • The Oxford Handbook of Social and Political Trust

    Eric M slaner, Eric M Uslaner•Oxford Handbook of Social and…•2017

  • The Moral Foundations of Trust

    Open Access•Eric M Uslaner•Moral Foundations of Trust•2001

  • Trust and Reciprocity

    Open Access•John P Carpenter, Jeffrey P Carpenter•Journal of Economic Behavior &…•2004

  • Do Social Connections Create Trust? An Examination Using New Longitudinal Data

    J L Glanville, M A Andersson et al.•Social Forces•2013

  • Measuring social capital

    Jan W Van Deth•International Journal of Social…•2003

  • Assessing the Validity of Generalized Trust Questions

    Patrick Sturgis, Peter Smith•International Journal of Public…•2010

  • Asking Probing Questions in Web Surveys

    Open Access•Dorothée Behr, Lars Kaczmirek et al.•Social Science Computer Review•2012

  • How do We Learn to Trust? A Confirmatory Tetrad Analysis of the Sources of Generalized Trust

    Open Access•J L Glanville, P Paxton•Social Psychology Quarterly•2007

  • An Empirical Comparison of Four Generalized Trust Scales

    Open Access•B G Robbins•Sociological Methods & Research•2024

  • Trust and Expected Trustworthiness

    Open Access•A Barr•The Economic Journal•2003

  • Foundations of Social Theory

    N Harris•Foundations of Social Theory•2024

  • Trust

    Piotr Sztompka•Trust•1999

  • Upbringing, Early Experiences of Discrimination and Social Identity

    Open Access•P T Dinesen•Scandinavian Political Studies•2010

  • Measuring Generalized Trust

    Lundmark, Sebastian Lundmark et al.•Public Opinion Quarterly•2016

  • The Civic Personality

    Open Access•P T Dinesen, Asbjørn Sonne Nørgaard et al.•Political Studies•2014

  • Does Generalized (Dis)Trust Travel? Examining the Impact of Cultural Heritage and Destination‐Country Environment on Trust of Immigrants

    Open Access•P T Dinesen•Political Psychology•2012

  • Spheres of trust

    Open Access•Michel Freitag, Markus Freitag et al.•European Journal of Political…•2009

  • What Have We Learned About Generalized Trust, If Anything

    Peter Nannestad•Annual Review of Political Science•2008

  • Individual-Level Evidence for the Causes and Consequences of Social Capital

    John Brehm, Wendy M Rahn et al.•American Journal of Political…•1997

  • An Experiment on the Effects of Embeddedness in Trust Situations

    Open Access•Vincent Busken, Vincent Buskens et al.•Rationality and Society•2000

  • Misanthropy and Political Ideology

    Morris Rosenberg•American Sociological Review•1956

  • Ethnic Diversity and Social Trust

    Open Access•P T Dinesen, Kim Mannemar Sønderskov•American Sociological Review•2015

  • How General Is Trust in "Most People"? Solving the Radius of Trust Problem

    Open Access•Jan Delhey, Kenneth Newton et al.•American Sociological Review•2011

  • The Radius of Trust Problem Remains Resolved

    Open Access•Jan Delhey, Kenneth Newton et al.•American Sociological Review•2014

  • Predicting Cross-National Levels of Social Trust

    Jan Delhey, Kenneth Newton•European Sociological Review•2005

  • Visual Design and Cognition in List-Style Open-Ended Questions in Web Probing

    Open Access•Katharina Meitinger, Tanja Kunz•Sociological Methods & Research•2024

  • Open-ended versus Closed Probes

    Open Access•Cornelia E Neuert, Katharina Meitinger et al.•Sociological Methods & Research•2023

  • Measuring Generalized Trust

    Open Access•B G Robbins•Sociological Methods & Research•2022

  • Trust in Social Relations

    Oliver Schilke, Martin Reimann et al.•Annual Review of Sociology•2021

  • Diversity, Social Capital, and Cohesion

    A Portes, Erik Vickstrom•Annual Review of Sociology•2011

  • Does Generalized Social Trust Lead to Associational Membership? Unravelling a Bowl of Well-Tossed Spaghetti

    Kim Mannemar Sønderskov, K M Sonderskov•European Sociological Review•2011

  • Identifying Social Trust in Cross-Country Analysis

    Open Access•Lars Torpe, Henrik Lolle•Social Indicators Research•2011

Unique citing works6
Citations per year2
Citation span2023 - 2026 (4)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 4

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae