The Effectiveness of vstep.3-5 Speaking Rater Training
Bibliographic Data
| ID | 23038175 |
|---|---|
| Authors | Nguyen Thi Ngoc Quynh, Thị Ngọc Quỳnh Nguyễn (0000-0001-6286-5139, University of Languages and International Studies), Nguyen Thi Quynh Yen (University of Languages and International Studies), Tran Thi Thu Hien (0000-0003-0705-926X), Nguyen Thi Phuong Thao (0000-0001-5742-8727, University of Languages and International Studies), Bui Thien Sao, Nguyen Thi Chi, Nguyen Thi (0000-0003-2273-1712, University of Languages and International Studies), Nguyen Quynh Hoa (0000-0003-2790-6139, University of Languages and International Studies) |
| Year | 2020 |
| Volume | 36 |
| Issue | 4 |
| Publication date | 2020-10-02 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | VNU Journal of Foreign Studies (JOURNAL) |
| Journal identifiers | ISSN: 2525-2445 • E-ISSN: 2525-2445 |
| Publisher | Vietnam National University of Languages and International Studies (PUBLISHER) |
| DOI | 10.25073/2525-2445/vnufs.4577 |
| OpenAlex | W3089924484 |
| Language | DE |
| Citations received | 2 |
| References cited | 3 |
Playing a vital role in assuring reliability of language performance assessment, rater training has been a topic of interest in research on large-scale testing. Similarly, in the context of VSTEP, the effectiveness of the rater training program has been of great concern. Thus, this research was conducted to investigate the impact of the VSTEP speaking rating scale training session in the rater training program provided by University of Languages and International Studies - Vietnam National University, Hanoi. Data were collected from 37 rater trainees of the program. Their ratings before and after the training session on the VSTEP.3-5 speaking rating scales were then compared. Particularly, dimensions of score reliability, criterion difficulty, rater severity, rater fit, rater bias, and score band separation were analyzed. Positive results were detected when the post-training ratings were shown to be more reliable, consistent, and distinguishable. Improvements were more noticeable for the score band separation and slighter in other aspects. Meaningful implications in terms of both future practices of rater training and rater training research methodology could be drawn from the study.
Context (archaeology) · Developmental psychology · Inter-rater reliability · Medical education · Rating scale · Reliability (semiconductor) · Scale (ratio) · Session (web analytics) · Training (meteorology) · Applied Psychology · Computer Science · Educational Technology and Assessment · EFL/ESL Teaching and Learning · Medicine · Psychology · Student Assessment and Feedback
| Citations per year | 0.5 |
|---|---|
| Citation span | 2022 - 2026 (5) |
| Highly cited | No |