Establishing Reliability and Validity of an Online Placement Test in an Omani Higher Education Institution

Datos Bibliográficos

ID5901020
AutoresSana Naqvi (0000-0002-6033-9351, Middle East College, autor de correspondencia), Reema Srivastava (Middle East College), Tareq Al Damen (Sultan Qaboos University), Asma Al Aufi (0000-0002-7540-550X, Middle East College), Amal Said Al-Amri (0000-0001-7197-5428, Middle East College), Amal Al Amri, Suleiman Al Adawi (Middle East College)
Año2023
Volumen8
Número1
Páginas61
Fecha de publicación2023-02-22
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaLanguages (JOURNAL)
Identificadores de la revistaISSN: 2226-471X • E-ISSN: 2226-471X
EditorialMDPI AG (PUBLISHER • IT)
DOI10.3390/languages8010061
OpenAlexW4321597124
IdiomaEN
Citas recibidas1
Referencias citadas30

Although placing students in the appropriate proficiency levels of post-secondary English programs is crucial for optimal learning, the evaluation of placement tests (PTs) in terms of establishing their reliability and validity is relatively under-researched. This study assesses the validity, reliability, and effectiveness of an in-house online PT. The content validity was established through the internal and external moderation of the question papers and answer keys while criterion-related concurrent validity was established via IELTS benchmarking. New Student Survey was used to investigate the face validity. The internal consistency and reliability of the reading test items were measured using Cronbach's alpha while descriptive statistics were calculated for the listening test. Paired sample t-test (dependent t-test) was used to assess the inter-rater reliability of the speaking and writing tests which were double-marked. The data analysis revealed that the PT was effective in placing students at different levels of the foundation program (FP) and the statistical analyses conducted to test the reliability and validity showed positive results for most of the test versions. The study offers useful insights to test developers and policymakers regarding the authentication of in-house tests and the creation of guidelines for PT design and evaluation

Construct validity · Content validity · Cronbach's alpha · Descriptive statistics · Face validity · Mathematics education · Medical education · Moderation · Psychometrics · Reading (process · Reading comprehension · Reliability (semiconductor · Statistics · Test (biology · Validity · Applied Psychology · Clinical Psychology · Computer Science · EFL/ESL Teaching and Learning · Mathematics · Medicine · Online and Blended Learning · Psychology · Social Psychology · Student Assessment and Feedback