Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Testing across languages in international comparisons

Cultural adaptation of consensus-based test translation review procedures

Bibliographic Data

ID11635563
AuthorsXueyu Zhao (0000-0002-0847-8135, Southeast University, corresponding author), Guillermo Solano‐Flores (0000-0001-5363-6828, Stanford University)
Year2020
Volume42
Issue7
Pages677-691
Publication date2020-12-02
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueJournal of Multilingual and Multicultural Development (JOURNAL)
Journal identifiersISSN: 0143-4632 • E-ISSN: 1747-7557
PublisherTaylor & Francis (PUBLISHER • GB)
DOI10.1080/01434632.2020.1852242
OpenAlexW3108338830
LanguageEN
Citations received3
References cited33

We investigated whether consensus-based test translation review procedures can be used effectively in cultural contexts with high social stratification. We staged two test translation review panels in China – where social stratification may potentially inhibit individuals’ ability to express opinion and disagreement. We adapted a consensus-based test translation review procedure in ways intended to ensure that all panellists could express their thinking. With the adapted procedure, we facilitated two panels charged with identifying errors in Chinese translations of items from PISA (OECD’s international test on skills for life). While social interactions during the panels reflected social status differences, the adaptations made it possible to capture the thinking of all panellists. The panels identified similar numbers of translation errors, but different sets of translation errors. We conclude that cultural adaptation addressing social stratification is critical to successfully implementing consensus-based procedures for test translation review in contexts with high social stratification. Ultimately, it contributes to ensuring fair, valid testing for culturally and linguistically diverse populations

Adaptation (eye · Biology · Cognitive psychology · Social science · Social stratification · Sociology · Test (biology · Translation (biology · Advanced Causal Inference Techniques · Computer Science · Evaluation and Performance Assessment · Psychology · Social Capital and Networks · Social Psychology

  • Test translation review

    Open Access•Xueyu Zhao, Guillermo Solano-Flores et al.•Frontiers in Education•2023

  • The Semiotics of Test Design

    Open Access•Guillermo Solano-Flores, Guillermo Solano‐Flores•Frontiers in Education•2021

  • Bridging culture, language, and test design work in mathematics item writing guidelines for Indigenous pupils

    Open Access•S Kanageswari Suppiah Shanmugam, Arsaythamby Veloo et al.•Diaspora Indigenous and Minority…•2026

  • Adapting Educational and Psychological Tests for Cross-Cultural Assessment

    Ronald K Hambleton, Peter F Merenda et al.•Adapting Educational and…•2004

  • Pisa 2018 Assessment and Analytical Framework

    OECD OECD•Pisa 2018 Assessment and…•2019

  • Treatment fidelity in outcome studies

    Open Access•Frank J Moncher, Ronald J Prinz•Clinical Psychology Review•1991

  • Educational standards and the changing discourse on education

    Hubert Ertl•Oxford Review of Education•2006

  • International comparisons of student attainment

    Harvey Goldstein•Assessment in Education:…•2004

  • Little Emperors

    Open Access•Lisa Cameron, Nisvan Erkal et al.•Science•2013

  • Program Integrity in Primary and Early Secondary Prevention

    Open Access•Andrew V Dane, Barry H Schneider•Clinical Psychology Review•1998

  • Translating Tests

    Fons Van De Vijver, Ronald K Hambleton•European Psychologist•1996

  • The Next Generation of the ITC Test Translation and Adaptation Guidelines

    Ronald K Hambleton•European Journal of Psychological…•2001

  • A conceptual framework for implementation fidelity

    Open Access•Christopher Carroll, Malcolm Patterson et al.•Implementation Science•2007

  • International Test Comparisons

    Xueyu Zhao, Guillermo Solano‐Flores et al.•International Multilingual…•2018

  • Translation procedures in OECD/Pisa 2000 international assessment

    Open Access•Aletta Grisay•Language Testing•2003

  • Pisa

    João Barroso, Liliana M Carvalho et al.•Revue française de pédagogie•2008

  • Implementation Matters

    Open Access•Joseph A Durlak, Emily P DuPre•American Journal of Community…•2008

  • A Framework for Measuring Fidelity of Implementation

    Open Access•Jeanne Century, Mollie Rudnick et al.•American Journal of Evaluation•2010

  • Cultural Adaptation of the Wellness Evaluation of Lifestyle

    Catherine Y Chang, Jane E Myers•Measurement and Evaluation in…•2003

  • Revisiting the Relationship Between International Assessment Outcomes and Educational Production

    Open Access•Martin Carnoy, Tatiana Khavenson et al.•American Educational Research…•2016

  • Interruption and Influence in Discussion Groups

    Open Access•Sik Hung Ng, Weiting Ng et al.•Journal of Language and Social…•1995

  • Transfer agents and global networks in the ‘transnationalization’ of policy

    Diane Stone•Journal of European Public Policy•2004

  • Globalization and the Growth of International Educational Testing and National Assessment

    David H Kamens, Connie L Mcneely•Comparative Education Review•2009

  • Interrupting the discourse on interruptions

    Open Access•Julia A Goldberg, Julia Goldberg•Journal of Pragmatics•1990

Unique citing works3
Citations per year0,6
Citation span2021 - 2026 (6)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 3

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae