Drawing on indigenous criteria for more authentic assessment in a specific-purpose language test

Health professionals interacting with patients

Bibliographic Data

ID19381007
AuthorsJohn Pill (0000-0002-8799-0267, American University of Beirut, Lebanon, corresponding author)
Year2016
Volume33
Issue2
Pages175-193
Publication date2016-04-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueLanguage Testing (JOURNAL)
Journal identifiersISSN: 0265-5322 • E-ISSN: 1477-0946
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/0265532215607400
OpenAlexW2337089871
LanguageEN
Citations received13
References cited13

The indigenous assessment practices (Jacoby & McNamara, 1999) in selected health professions were investigated to inform a review of the scope of assessment in the speaking sub-test of a specific-purpose English language test for health professionals, the Occupational English Test (OET). The assessment criteria in current use on the test represent a generalized view of language and are concerned with Overall Communicative Effectiveness, Fluency, Intelligibility, Appropriateness of Language, and Resources of Grammar and Expression. The research study focused on healthcare consultations between trainee health professionals and patients. Educators and supervisors observed these interactions and subsequently provided feedback on trainees’ performances. The assumption was that, in their comments, educators would give information pertinent to trainees’ acculturation to the expectations and behaviours of the profession, that is, to “what matters” to practitioners. Thematic analysis was undertaken to establish the aspects of performance that matter to health professionals in these contexts. Data for each profession were coded independently. Clear similarities across the professions became apparent as themes emerged. An exploratory conceptual model of what health professionals value in the consultation was developed, comprising three focal areas: foundation, performance and goals of the consultation. Findings from the analysis provided an empirical basis for the generation and definition of two additional, professionally relevant criteria for use in the OET speaking sub-test – Clinician Engagement and Management of Interaction – and of a checklist of performance indicators to be used to train assessors in applying the new criteria. This process of developing, through close analysis of domain experts’ commentary, test criteria that are potentially more authentic to the target language use situation is novel and may be replicated effectively in other specific-purpose language testing contexts

Checklist · Fluency · Health care · Language assessment · Mathematics education · Medical education · Pedagogy · Qualitative research · Sociology · Thematic analysis · Applied Psychology · Interpreting and Communication in Healthcare · Language, Discourse, Communication Strategies · Medicine · Psychology · Second Language Learning and Teaching

Tools

Open DOISci-Hub