Establishing Reliability and Validity of an Online Placement Test in an Omani Higher Education Institution

Dados Bibliográficos

ID5901020
AutoresSana Naqvi (0000-0002-6033-9351, Middle East College, autor correspondente), Reema Srivastava (Middle East College), Tareq Al Damen (Sultan Qaboos University), Asma Al Aufi (0000-0002-7540-550X, Middle East College), Amal Said Al-Amri (0000-0001-7197-5428, Middle East College), Amal Al Amri, Suleiman Al Adawi (Middle East College)
Ano2023
Volume8
Fascículo1
Páginas61
Data de publicação2023-02-22
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoLanguages (JOURNAL)
Identificadores do periódicoISSN: 2226-471X • E-ISSN: 2226-471X
EditoraMDPI AG (PUBLISHER • IT)
DOI10.3390/languages8010061
OpenAlexW4321597124
IdiomaEN
Citações recebidas1
Referências citadas30

Although placing students in the appropriate proficiency levels of post-secondary English programs is crucial for optimal learning, the evaluation of placement tests (PTs) in terms of establishing their reliability and validity is relatively under-researched. This study assesses the validity, reliability, and effectiveness of an in-house online PT. The content validity was established through the internal and external moderation of the question papers and answer keys while criterion-related concurrent validity was established via IELTS benchmarking. New Student Survey was used to investigate the face validity. The internal consistency and reliability of the reading test items were measured using Cronbach's alpha while descriptive statistics were calculated for the listening test. Paired sample t-test (dependent t-test) was used to assess the inter-rater reliability of the speaking and writing tests which were double-marked. The data analysis revealed that the PT was effective in placing students at different levels of the foundation program (FP) and the statistical analyses conducted to test the reliability and validity showed positive results for most of the test versions. The study offers useful insights to test developers and policymakers regarding the authentication of in-house tests and the creation of guidelines for PT design and evaluation

Construct validity · Content validity · Cronbach's alpha · Descriptive statistics · Face validity · Mathematics education · Medical education · Moderation · Psychometrics · Reading (process · Reading comprehension · Reliability (semiconductor · Statistics · Test (biology · Validity · Applied Psychology · Clinical Psychology · Computer Science · EFL/ESL Teaching and Learning · Mathematics · Medicine · Online and Blended Learning · Psychology · Social Psychology · Student Assessment and Feedback