Modeling rater cognition in translation assessment

An exploratory investigation based on think-aloud, eye-tracking, and interview data

Dados Bibliográficos

ID21584088
AutoresChao Han (0009-0007-9698-759X, Hacettepe University), Shirong Chen (0000-0002-2159-8844, Tohoku University), Jia Feng (0009-0007-3747-4495, Renmin University of China)
Ano2025
Volume37
Fascículo4
Páginas590-626
Data de publicação2025-10-03
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoTarget International Journal of Translation Studies (JOURNAL)
Identificadores do periódicoISSN: 0924-1884 • E-ISSN: 1569-9986
EditoraJohn Benjamins Publishing Company (PUBLISHER • NL)
DOI10.1075/target.23040.han
OpenAlexW4414116652
IdiomaEN
Citações recebidas2
Referências citadas36

In this exploratory study, we investigated rater cognition in English–Chinese translation assessment, drawing on think-aloud, eye-tracking, and interview data. We designed a 3 × 2 × 2 experiment in which experienced raters assessed eighteen renditions of three levels of quality for each translation direction, using a Likert-type scale or analytic rubric scale. We found that: (a) the raters heeded meaning transfer more frequently than other contents; (b) they utilized a variety of processing actions, but a core subset involving eight actions constituted the mainstay; (c) to make a scoring decision, the raters mainly consulted the source text, the target texts, and the rating scale, but also displayed other patterns of interaction (e.g., relying on target texts only); (d) they fixated more frequently per time unit and proportionally longer on the target texts; and (e) translation direction and scoring method seemed to have modulated rater cognition. The implications of these findings for translation assessment are discussed

Cognition · Inter-rater reliability · Rating scale · Rubric · Natural Language Processing Techniques · Subtitles and Audiovisual Media · Translation Studies and Practices