Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Factors Associated with Interviewers’ Evaluations of Respondents’ Performance in Telephone Interviews

Behavior, Response Quality Indicators, and Characteristics of Respondents and Interviewers

Bibliographic Data

ID7362944
AuthorsDana Garbarski (0000-0002-7764-9751, Department of Sociology, and Director, University Core Curriculum, Loyola University Chicago Associate Professor, , Chicago, IL, US, corresponding author), Jennifer Dykema (0000-0002-7707-9752, University of Wisconsin Survey Center, University of Wisconsin-Madison Associate Professor, Department of Sociology, University of Wisconsin-Madison, Madison, WI, US; and Faculty Director , Madison, WI, US), Nora Cate Schaeffer (0000-0001-9837-3603, Department of Sociology, University of Wisconsin-Madison Professor Emerita, , Madison, WI, US), Cameron P Jones (0000-0002-4806-4009, Department of Statistics, University of Wisconsin-Madison Graduate Student, , Madison, WI, US), Tiffany S Neman (Department of Sociology, University of Wisconsin-Madison PhD Candidate, , Madison, WI, US), Tiffany Neman (0000-0002-2403-4008), Dorothy Farrar Edwards (0000-0001-5731-7154, Department of Kinesiology and Department of Medicine, University of Wisconsin-Madison Professor, , Madison, WI, US)
Year2023
Volume87
IssueS1
Pages480-506
Publication date2023-07-20
Open AccessYes
TypeARTICLE
VenuePublic Opinion Quarterly (JOURNAL)
Journal identifiersISSN: 0033-362X • E-ISSN: 1537-5331
PublisherOxford University Press (OUP) (PUBLISHER)
DOI10.1093/poq/nfad028
PMID37705920
OpenAlexW4385094221
LanguageEN
Citations received3
References cited34

Interviewers’ postinterview evaluations of respondents’ performance (IEPs) are paradata, used to describe the quality of the data obtained from respondents. IEPs are driven by a combination of factors, including respondents’ and interviewers’ sociodemographic characteristics and what actually transpires during the interview. However, relatively few studies examine how IEPs are associated with features of the response process, including facets of the interviewer-respondent interaction and patterns of responding that index data quality. We examine whether features of the response process—various respondents’ behaviors and response quality indicators—are associated with IEPs in a survey with a diverse set of respondents focused on barriers and facilitators to participating in medical research. We also examine whether there are differences in IEPs across respondents’ and interviewers’ sociodemographic characteristics. Our results show that both respondents’ behaviors and response quality indicators predict IEPs, indicating that IEPs reflect what transpires in the interview. In addition, interviewers appear to approach the task of evaluating respondents with differing frameworks, as evidenced by the variation in IEPs attributable to interviewers and associations between IEPs and interviewers’ gender. Further, IEPs were associated with respondents’ education and ethnoracial identity, net of respondents’ behaviors, response quality indicators, and sociodemographic characteristics of respondents and interviewers. Future research should continue to build on studies that examine the correlates of IEPs to better inform whether, when, and how to use IEPs as paradata about the quality of the data obtained

Interview · Medical education · Quality (philosophy · Respondent · Set (abstract data type · Focus Groups and Qualitative Methods · Medicine · Patient Satisfaction in Healthcare · Psychology · Survey Methodology and Nonresponse · Applied Psychology · Social Psychology

  • Analysis of Hard Refusals to Continue Interviews in Telephone Surveys on Political Topics

    Open Access•V B Zvonovsky, Александр Владимирович Ходыкин et al.•Sociological Journal•2026

  • Local governance of sport

    Open Access•André Dionísio Sesinando, Jordi Seguí-Urbaneja et al.•Frontiers in Sports and Active…•2026

  • Augmenting Surveys with Paradata, Administrative Data, and Contextual Data

    Open Access•Joseph W Sakshaug, Bella Struminskaya•Public Opinion Quarterly•2023

  • A mixed‐effects multinomial logistic regression model

    Open Access•Donald Hedeker•Statistics in Medicine•2003

  • A Continuum of Impression Formation, from Category-Based to Individuating Processes

    Susan T Fiske, Steven L Neuberg•Advances in Experimental Social…•1990

  • Interviewers’ Ratings of Respondents’ Health

    Open Access•Dana Garbarski, Nora Cate Schaeffer et al.•The Journals of Gerontology…•2017

  • Straightlining

    Open Access•Yujin Kim, Jennifer Dykema et al.•Social Science Computer Review•2018

  • Discourse Cues That Respondents Have Misunderstood Survey Questions

    Michael F Schober, Jonathan Bloom et al.•Discourse Processes•2004

  • The Discovery of Grounded Uncertainty

    Nora Cate Schaeffer, Elizabeth Thomson•Sociological Methodology•1992

  • Sources of Variance in the Accuracy of Interviewer Observations

    Open Access•Brady T West, Dan Li•Sociological Methods & Research•2019

  • Standardization vs. Rapport

    Danielle Lavin, D W Maynard•American Sociological Review•2001

  • Do Interviewer Assessments of Respondents’ Performance Accurately Reflect Response Behavior

    Open Access•Laura Jacobs, Geert Loosveldt et al.•CAM•2020

  • Response Heaping in Interviewer-Administered Surveys

    Allyson L Holbrook, Smriti Anand et al.•Public Opinion Quarterly•2014

  • Do Interviewer Postsurvey Evaluations of Respondents’ Engagement Measure Who Respondents Are or What They Do? A Behavior Coding Study

    Antje Kirchner, Kristen Olson et al.•Public Opinion Quarterly•2017

  • Does Similarity Breed Respect

    Aída Hurtado•Public Opinion Quarterly•1994

  • Factors Affecting the Accuracy of Interviewer Observations

    Brady T West, Frauke Kreuter•Public Opinion Quarterly•2013

  • Effect of Interviewer Experience on Interview Pace and Interviewer Attitudes

    K Olson, Andy Peytchev•Public Opinion Quarterly•2007

  • The Impact of Question and Respondent Characteristics on Comprehension and Mapping Difficulties

    Allyson Holbrook, Y I Cho et al.•Public Opinion Quarterly•2006

  • Evaluating the Measurement Error of Interviewer Observed Paradata

    Jennifer Sinibaldi, Gabriele B Durrant et al.•Public Opinion Quarterly•2013

  • Interviewing Practices, Conversational Practices, and Rapport

    Open Access•Dana Garbarski, Nora Cate Schaeffer et al.•Sociological Methodology•2016

  • A Practical Technique for Improving the Accuracy of Interviewer Observations of Respondent Characteristics

    Open Access•Brady T West, Frauke Kreuter•CAM•2015

Citations per year1
Citation span2023 - 2026 (4)
Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae