Ben Naismith
Biographic Data
| ID | 2486318 |
|---|---|
| NAME | Ben Naismith |
| GIVEN NAMES | Ben |
| FAMILY NAME | Naismith |
| SIGNATURE | BEN NAISMITH |
| AFFILIATIONS | University of Pittsburgh |
| ORCID | 0000-0001-8347-3142 |
| VERIFIED | Yes |
| TOTAL WORKS | 5 |
| TOTAL CITATIONS | 1 |
| WORKS AS AUTHOR | 5 |
| WORKS AS EDITOR | 0 |
| FIRST PUBLICATION YEAR | 2021 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 1 |
A Systematic Review of Test Component Ordering with Implications for Language Assessment
How to optimize ordering the parts of a language test (e.g., items, tasks, and sections) is often overlooked or assumed to be self-evident. However, ordering choices are an essential component of test design as they may impact test takers’ objective performance, perceived performance, or affective states. In this paper, we report on a systematic review of test component ordering research, focusing on 88 studies from 1933 to 2023. We provide a nar…
The impact of collocational proficiency features on expert ratings of L2 English learners’ writing
Lexical proficiency is a multifaceted phenomenon that greatly impacts human judgments of writing quality. However, the importance of collocations’ contribution to proficiency assessment has received less attention than that of single words, despite collocations’ essential role in language production. This study, therefore, investigated how aspects of collocational proficiency affect the ratings that examiners give to English learner essays. To do…
Developing an Automatic Pronunciation Scorer
Globalization and increases in the numbers of English language learners have led to a growing demand for English proficiency assessments of spoken language. In this paper, we describe the development of an automatic pronunciation scorer built on state-of-the-art deep neural network models. The model is trained on a bespoke human-rated dataset that reflects current perspectives on pronunciation and intelligibility. The new scorer is evaluated alon…
Handle it in-house
Vocabulary lists of high-frequency lexical items are an important resource in language education and a key product of corpus research. However, no single vocabulary list will be useful for every learning context, with the appropriateness of such lists affected by the corpora on which they are based. This paper investigates the impact of corpus selection on one measure of lexical sophistication, Advanced Guiraud, focusing on two frequency lists or…
Multiword sequences in English language learners’ speech
Multiword sequences in English language learners’ speech
Handle it in-house
Vocabulary lists of high-frequency lexical items are an important resource in language education and a key product of corpus research. However, no single vocabulary list will be useful for every learning context, with the appropriateness of such lists affected by the corpora on which they are based. This paper investigates the impact of corpus selection on one measure of lexical sophistication, Advanced Guiraud, focusing on two frequency lists or…
The impact of collocational proficiency features on expert ratings of L2 English learners’ writing
Lexical proficiency is a multifaceted phenomenon that greatly impacts human judgments of writing quality. However, the importance of collocations’ contribution to proficiency assessment has received less attention than that of single words, despite collocations’ essential role in language production. This study, therefore, investigated how aspects of collocational proficiency affect the ratings that examiners give to English learner essays. To do…
Developing an Automatic Pronunciation Scorer
Globalization and increases in the numbers of English language learners have led to a growing demand for English proficiency assessments of spoken language. In this paper, we describe the development of an automatic pronunciation scorer built on state-of-the-art deep neural network models. The model is trained on a bespoke human-rated dataset that reflects current perspectives on pronunciation and intelligibility. The new scorer is evaluated alon…
A Systematic Review of Test Component Ordering with Implications for Language Assessment
How to optimize ordering the parts of a language test (e.g., items, tasks, and sections) is often overlooked or assumed to be self-evident. However, ordering choices are an essential component of test design as they may impact test takers’ objective performance, perceived performance, or affective states. In this paper, we report on a systematic review of test component ordering research, focusing on 88 studies from 1933 to 2023. We provide a nar…
Linguistics (4 works) · Computer Science (3 works) · Natural language processing (3 works) · Natural Language Processing Techniques (3 works) · Psychology (3 works) · Second Language Acquisition and Learning (3 works) · Artificial Intelligence (2 works) · Language assessment (2 works) · Language proficiency (2 works) · Philosophy (2 works)