Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Different paths, same destination? Comparison of two approaches to developing situational judgment tests for cross‐cultural competence

Bibliographic Data

ID6415423
AuthorsXiaowen Chen (0000-0003-1790-691X, Department of Psychology Saint Louis University Saint Louis Missouri USA), Gary N Burns (0000-0001-7484-567X, College of Psychology and Liberal Arts Florida Institute of Technology Melbourne Florida USA)
Year2025
Volume74
Issue4
Publication date2025-08-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueApplied Psychology (JOURNAL)
Journal identifiersISSN: 0269-994X • E-ISSN: 1464-0597
PublisherWiley (PUBLISHER • GB)
DOI10.1111/apps.70024
OpenAlexW4412999780
LanguageEN
References cited76

Assessing cross‐cultural competence (3C) remains a challenge, as traditional self‐report measures often fail to capture the complexity of intercultural interactions and are vulnerable to validity concerns. Situational judgment tests (SJTs) offer a promising alternative by simulating real‐world decision‐making in intercultural contexts. This study develops and evaluates two distinct SJTs via two item development methods, work‐sampling and construct‐based, in measuring 3C. Using a within‐person design, we examine their psychometric properties, including reliability, internal structure, face validity, susceptibility to social desirability bias, and criterion validity. Both SJTs demonstrate acceptable reliability and correlations with a self‐report 3C measure, overseas life satisfaction, and sociocultural adaptation. However, the construct‐based SJT appears more susceptible to social desirability and has lower face validity compared to the work‐sampling SJT. Only the work‐sampling SJT explained peer‐rated multicultural team performance. We contribute to the refinement of 3C assessment by developing the SJTs that could serve as viable alternatives to self‐report scales. Our findings also suggest that work sampling SJTs may offer certain advantages over construct‐based SJTs in measuring 3C

Competence (human resources · Situational ethics · Applied Psychology · Gender Diversity and Inequality · International Student and Expatriate Challenges · Medical Education and Admissions · Psychology · Social Psychology

  • Cultural Intelligence

    Open Access•Ang, Soon Ang et al.•Management and Organization Review•2007

  • Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities.

    James C Anderson, David W Gerbing•Journal of Applied Psychology•1991

  • Recommendations for Creating Better Concept Definitions in the Organizational, Behavioral, and Social Sciences

    Open Access•Philip M Podsakoff, Scott B Mackenzie et al.•Organizational Research Methods•2016

  • The Big Five Personality Characteristics as Predictors of Expatriate's Desire to Terminate the Assignment and Supervisor‐rated Performance

    Open Access•Paula Caligiuri, Paula M Caligiuri•Personnel Psychology•2000

  • Mindful Learning

    Open Access•Ellen J Langer•Current Directions in Psychological…•2000

  • You can take it with you

    Margaret A Shaffer, David A Harrison et al.•Journal of Applied Psychology•2006

  • The Influence of the Spouse on American Expatriate Adjustment and Intent to Stay in Pacific Rim Overseas Assignments

    Open Access•J Stewart Black, Gregory Stephens et al.•Journal of Management•1989

  • Toward a Comprehensive Model of International Adjustment

    J Stewart Black, Mark E Mendenhall et al.•Academy of Management Review•1991

  • The Satisfaction With Life Scale

    Ed Diener, Robert A Emmons et al.•Journal of Personality Assessment•1985

  • Cross‐cultural social intelligence

    Open Access•Ma Evelina Ascalon, Deidra J Schleicher et al.•Cross Cultural Management An…•2008

  • Development of a Theory-Based Assessment of Team Member Effectiveness

    Open Access•Misty L Loughry, Matthew Ohland et al.•Educational and Psychological…•2007

  • Harmonizing Work, Family, and Personal Life

    Open Access•Paula Caligiuri, Steven Poelmans et al.•Harmonizing Work, Family, and…•2008

  • Development of reliable and valid short forms of the marlowe-crowne social desirability scale

    Open Access•William M Reynolds•Journal of Clinical Psychology•1982

  • Detecting and Deterring Insufficient Effort Responding to Surveys

    Open Access•Jason L Huang, Paul Curran et al.•Journal of Business and Psychology•2011

  • Intercultural Competence

    Kwok Leung, Ang et al.•Annual Review of Organizational…•2014

  • In search of cross-cultural competence

    Open Access•Xiaowen Chen, Chen Xiaowen et al.•International Journal of…•2021

  • The Development of a New Instrument of Intercultural Communication Competence

    Open Access•Lily A Arasaratnam•Journal of Intercultural…•2009

  • The prediction of psychological and sociocultural adjustment during cross-cultural transitions

    Open Access•Wendy Searle, C Ward•International Journal of…•1990

  • Communication and cross-cultural adaptation

    Open Access•William B Gudykunst, Ge Gao et al.•International Journal of…•1988

  • Identification and Assessment of Intercultural Competence as a Student Outcome of Internationalization

    Open Access•Darla K Deardorff•Journal of Studies in International…•2006

  • Tests for comparing elements of a correlation matrix

    James H Steiger•Psychological Bulletin•1980

  • Assessing Cross-Cultural Competence

    Open Access•D Matsumoto, Hyisung C Hwang•Journal of Cross-Cultural…•2013

Citation velocityhistorical
Highly citedNo

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae