John M Norris
Biographic Data
| ID | 3843619 |
|---|---|
| NAME | John M Norris |
| GIVEN NAMES | John M |
| FAMILY NAME | Norris |
| SIGNATURE | NORRIS J M |
| AFFILIATIONS | University of Hawaiʻi at Mānoa |
| ORCID | 0000-0002-0313-1263 |
| VERIFIED | Yes |
| TOTAL WORKS | 34 |
| TOTAL CITATIONS | 183 |
| AUTHOR COUNT | 33 |
| EDITOR COUNT | 1 |
| FIRST PUBLICATION YEAR | 1955 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 5 |
Meta‐analysis
Meta‐analysis comprises a set of systematic and well‐established procedures for estimating population‐level effects, such as standardized mean differences or correlation coefficients, both as an overall effect and as a function of potential moderating variables. In doing so, meta‐analysis improves upon a number of limitations inherent in traditional, nonsystematic reviews. This entry lays out some of these benefits as well as the conceptual and e…
Program Evaluation and Language Teaching
Language program evaluation involves gathering evidence about language education programs to understand, improve, judge, justify, and make decisions about them. Evidence is generated through empirical qualitative and quantitative data collection in response to the needs and questions of language program stakeholders. Language program evaluation has developed since the mid‐20th century, evolving from a primary focus on experimental comparisons of …
The relationship between poststimulus pause, learner proficiency, and working memory in an Elicited Imitation Task
The Elicited Imitation Task (EIT) is a popular technique for efficiently measuring global proficiency in multiple languages, and accumulated evidence indicates high reliability and strong relationships with other proficiency measures. Nevertheless, several dimensions of EIT design remain open to investigation, including the assumption that a pause is required in between the aural stimulus and oral response, to ensure processing of the input and p…
Psychometric approaches to analyzing C-tests
The C-test is a type of gap-filling test designed to efficiently measure second language proficiency. The typical C-test consists of several short paragraphs with the second half of every second word deleted. The words with deleted parts are considered as items nested within the corresponding paragraph. Given this testlet structure, it is commonly taken for granted that the C-test design may violate the local independence assumption. However, thi…
Test review: TestDaF
Statistical Significance Testing in Second Language Research: Basic Problems and Suggestions for Reform
Traditions of statistical significance testing in second language (L2) quantitative research are strongly entrenched in how researchers design studies, select analyses, and interpret results. However, statistical significance tests using p values are commonly misinterpreted by researchers, reviewers, readers, and others, leading to confusion regarding the actual findings of primary studies and critical challenges for the accumulation of meaningfu…
Improving Second Language Quantitative Research
Guidelines for Reporting Quantitative Methods and Results in Primary Research
Adequate reporting of quantitative research about language learning involves careful consideration of the logic, rationale, and actions underlying both study designs and the ways in which data are analyzed. These guidelines, commissioned and vetted by the board of directors of Language Learning, outline the basic expectations for reporting of quantitative primary research with a specific focus on Method and Results sections. The guidelines are ba…
Meta‐Analysis
Meta‐analysis is a secondary research methodology consisting of techniques for reviewing quantitative primary research studies; extracting, combining, and comparing findings; and interpreting what is known about particular questions, variables, or other foci that have generated substantial empirical attention.
Program Evaluation
According to Patton (2008), “ Program evaluation is the systematic collection of information about the activities, characteristics, and results of programs to make judgments about the program, improve or further develop program effectiveness, inform decisions about future programming, and/or increase understanding” (p. 39, emphasis in original).
Laboratory work in early geoscience: Changing the story
Forthcoming in Language Teaching
An abstract is not available for this content. As you have access to this content, full HTML content is provided on this page. A PDF of this content is also available in through the ‘Save PDF’ action button
Research synthesis
When in the late 1990s we set out to review the accumulated research on second language (L2) instructional effectiveness, it was with a sense – though no certainty – that a journey into the uncharted territory of systematic research synthesis would eventually prove worth the effort. In order to find a fitting methodology, and in the absence of any guidance within applied linguistics, we willingly delved into challenging techniques and debates fro…
Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity
In this article, we examine current practices in the measurement of syntactic complexity to illustrate the need for more organic and sustainable practices in the measurement of complexity, accuracy, and fluency (CAF) in second language production. Through in-depth review of examples drawn from research on instructed second language acquisition, we identify and discuss challenges to the evidentiary logic that underlies current approaches. We also …
The Future of Research Synthesis in Applied Linguistics: Beyond Art or Science
TESOL Quarterly publishes brief commentaries on aspects of qualitative and quantitative research. This issue features a discussion of research synthesis in applied linguistics
Synthesizing Research on Language Learning and Teaching
This volume presents the first collection of work on research synthesis in applied linguistics. It introduces readers to a cutting-edge approach for reviewing and summarizing exactly what accumulated research has to say about theoretical and practical subjects. John Norris and Lourdes Ortega first elucidate the value and practice of synthesis, and they challenge all members of the research community to adopt a “synthetic ethic”. The book then f…
Exploring the Uses and Usefulness of ACTFL Oral Proficiency Ratings and Standards in College Foreign Language Departments
Oral proficiency ratings, based on the ACTFL Guidelines and derived from live or simulated oral proficiency interviews (SOPIs), enjoy widespread use in the United States. In particular, college foreign language departments have increasingly adopted oral proficiency ratings as a way of establishing standards for language or graduation requirements. In the study reported here, the authors explored the intended uses of proficiency‐based standards in…
Interpretations, intended uses and designs in task-based language assessment
Examinee abilities and task difficulty in task-based second language performance assessment
This article summarizes findings from investigations into the development and use of a prototype English language task-based performance test. Data included performances by 90 examinees on 13 complex and skills-integrativetasks, a priori estimations of examinee proficiency differences, a priori estimations of task difficulty based on cognitive processing demands, performance ratings according to task-specific as well as holistic scales and criter…
Does Type of Instruction Make a Difference? Substantive Findings From a Meta‐analytic Review
This study employed systematic procedures for research synthesis and meta‐analysis to summarize findings from experimental and quasi‐experimental investigations into the effectiveness of L2 instruction published between 1980 and 1998. Comparisons of average effect sizes from 49 unique sample studies reporting sufficient data indicated that focused L2 instruction results in large target‐oriented gains, that explicit types of instruction are more e…
Effectiveness of L2 Instruction: A Research Synthesis and Quantitative Meta-analysis
This study employed (and reports in detail) systematic procedures for research synthesis and meta-analysis to summarize findings from experimental and quasi-experimental investigations into the effectiveness of L2 instruction published between 1980 and 1998. Comparisons of average effect sizes from 49 unique sample studies reporting sufficient data indicated that focused L2 instruction results in large target-oriented gains, that explicit types o…
New World - New Creation: Mission in Power and Faith
Repeatability of Principal Components in Samples: Normal and Non-Normal Data Sets Compared
The asymptotic theory of the distribution of the latent roots and vector of principal components analysis (PCA) of samples has hitherto been tied t multivariate normal (MVN) distributions. However, much real behavior dat are not normal. The results of the present study show, using arguments base on Monte Carlo methods, that if there is enough meaningful structure in th population, then PCA of samples of data with multivariate non-normal (NN distr…
The Analysis of Farm Organisation: An Approach to the Classification of Agricultural Land in Britain
The assumption that land use data can be used to facilitate the interpretation of spatial changes in land quality in the United Kingdom, and thereby provide the basis for a classification of agricultural land, is not new.1 Indeed, it is implicit in agricultural land classification schemes that land quality is an important factor in determining the selection of systems of production and that this can be meaningfully demonstrated by grouping land u…
Demographic Regions in Libya: A Principal Components Analysis of Economic and Demographic Variables
Effectiveness of L2 Instruction: A Research Synthesis and Quantitative Meta-analysis
This study employed (and reports in detail) systematic procedures for research synthesis and meta-analysis to summarize findings from experimental and quasi-experimental investigations into the effectiveness of L2 instruction published between 1980 and 1998. Comparisons of average effect sizes from 49 unique sample studies reporting sufficient data indicated that focused L2 instruction results in large target-oriented gains, that explicit types o…
Guidelines for Reporting Quantitative Methods and Results in Primary Research
Adequate reporting of quantitative research about language learning involves careful consideration of the logic, rationale, and actions underlying both study designs and the ways in which data are analyzed. These guidelines, commissioned and vetted by the board of directors of Language Learning, outline the basic expectations for reporting of quantitative primary research with a specific focus on Method and Results sections. The guidelines are ba…
Exploring the Uses and Usefulness of ACTFL Oral Proficiency Ratings and Standards in College Foreign Language Departments
Oral proficiency ratings, based on the ACTFL Guidelines and derived from live or simulated oral proficiency interviews (SOPIs), enjoy widespread use in the United States. In particular, college foreign language departments have increasingly adopted oral proficiency ratings as a way of establishing standards for language or graduation requirements. In the study reported here, the authors explored the intended uses of proficiency‐based standards in…
Statistical Significance Testing in Second Language Research: Basic Problems and Suggestions for Reform
Traditions of statistical significance testing in second language (L2) quantitative research are strongly entrenched in how researchers design studies, select analyses, and interpret results. However, statistical significance tests using p values are commonly misinterpreted by researchers, reviewers, readers, and others, leading to confusion regarding the actual findings of primary studies and critical challenges for the accumulation of meaningfu…
The Future of Research Synthesis in Applied Linguistics: Beyond Art or Science
TESOL Quarterly publishes brief commentaries on aspects of qualitative and quantitative research. This issue features a discussion of research synthesis in applied linguistics
The Policy of the British Cabinet in the Nootka Crisis
The Policy of the British Cabinet in the Nootka Crisis JOHN M. NORRIS JOHN M. NORRIS Search for other works by this author on: Oxford Academic Google Scholar The English Historical Review, Volume LXX, Issue CCLXXVII, October 1955, Pages 562–580, https://doi.org/10.1093/ehr/LXX.CCLXXVII.562 Published: 01 October 1955
Demographic Regions in Libya: A Principal Components Analysis of Economic and Demographic Variables
Improving Second Language Quantitative Research
Research synthesis
When in the late 1990s we set out to review the accumulated research on second language (L2) instructional effectiveness, it was with a sense – though no certainty – that a journey into the uncharted territory of systematic research synthesis would eventually prove worth the effort. In order to find a fitting methodology, and in the absence of any guidance within applied linguistics, we willingly delved into challenging techniques and debates fro…
Proposals for Promoting Religion and Literature in Canada, Nova Scotia, and New Brunswick
The Policy of the British Cabinet in the Nootka Crisis
The Policy of the British Cabinet in the Nootka Crisis JOHN M. NORRIS JOHN M. NORRIS Search for other works by this author on: Oxford Academic Google Scholar The English Historical Review, Volume LXX, Issue CCLXXVII, October 1955, Pages 562–580, https://doi.org/10.1093/ehr/LXX.CCLXXVII.562 Published: 01 October 1955
Benedict Arnold's Plan for Privateering, 1782
HE two documents printed below' give an interesting sidelight on Benedict Arnold's fortunes and state of mind after his return from James River Expedition, his last regular military employment. With his restless, ambitious Yankee mind endlessly producing great schemes for his advancement, based on someone else's money, he could not long remain content with role of a British brigadier-general on half-pay. He turned to his first trade, sea, and evo…
Constitutional Reason of State: The Survival of the Constitutional Order
Find information about UTP Journals. University of Toronto Press is Canada’s leading academic publisher and one of the largest university presses in North America, with particular strengths in the social sciences, humanities, and business. The Book Publishing Division is widely recognized in Canada for its strength in history, political science, sociology, Indigenous studies, and cultural studies. Internationally, UTP is a leading publisher of me…
Burke and the Nature of Politics: The Age of the American Revolution
Find information about UTP Journals. University of Toronto Press is Canada’s leading academic publisher and one of the largest university presses in North America, with particular strengths in the social sciences, humanities, and business. The Book Publishing Division is widely recognized in Canada for its strength in history, political science, sociology, Indigenous studies, and cultural studies. Internationally, UTP is a leading publisher of me…
The Structure of Politics at the Accession of George III. George 111 and the Historians. The End of North’s Ministry, 1780-1782
Find information about UTP Journals. University of Toronto Press is Canada’s leading academic publisher and one of the largest university presses in North America, with particular strengths in the social sciences, humanities, and business. The Book Publishing Division is widely recognized in Canada for its strength in history, political science, sociology, Indigenous studies, and cultural studies. Internationally, UTP is a leading publisher of me…
Culture and History: Prolegomena to the Comparative Study of Civilizations. Theory and History: An Interpretation of Social and Economic Evolution
Find information about UTP Journals. University of Toronto Press is Canada’s leading academic publisher and one of the largest university presses in North America, with particular strengths in the social sciences, humanities, and business. The Book Publishing Division is widely recognized in Canada for its strength in history, political science, sociology, Indigenous studies, and cultural studies. Internationally, UTP is a leading publisher of me…
The Eighteenth-Century Commonwealthman: Studies in the Transmission, Development and Circumstance of English Liberal Thought from the Restoration of Charles II until the War with the Thirteen Colonies
Find information about UTP Journals. University of Toronto Press is Canada’s leading academic publisher and one of the largest university presses in North America, with particular strengths in the social sciences, humanities, and business. The Book Publishing Division is widely recognized in Canada for its strength in history, political science, sociology, Indigenous studies, and cultural studies. Internationally, UTP is a leading publisher of me…
The Correspondence of Edmund Burke . IV. July 1778-June 1782
Find information about UTP Journals. University of Toronto Press is Canada’s leading academic publisher and one of the largest university presses in North America, with particular strengths in the social sciences, humanities, and business. The Book Publishing Division is widely recognized in Canada for its strength in history, political science, sociology, Indigenous studies, and cultural studies. Internationally, UTP is a leading publisher of me…
The Analysis of Farm Organisation: An Approach to the Classification of Agricultural Land in Britain
The assumption that land use data can be used to facilitate the interpretation of spatial changes in land quality in the United Kingdom, and thereby provide the basis for a classification of agricultural land, is not new.1 Indeed, it is implicit in agricultural land classification schemes that land quality is an important factor in determining the selection of systems of production and that this can be meaningfully demonstrated by grouping land u…
Demographic Regions in Libya: A Principal Components Analysis of Economic and Demographic Variables
Repeatability of Principal Components in Samples: Normal and Non-Normal Data Sets Compared
The asymptotic theory of the distribution of the latent roots and vector of principal components analysis (PCA) of samples has hitherto been tied t multivariate normal (MVN) distributions. However, much real behavior dat are not normal. The results of the present study show, using arguments base on Monte Carlo methods, that if there is enough meaningful structure in th population, then PCA of samples of data with multivariate non-normal (NN distr…
New World - New Creation: Mission in Power and Faith
Effectiveness of L2 Instruction: A Research Synthesis and Quantitative Meta-analysis
This study employed (and reports in detail) systematic procedures for research synthesis and meta-analysis to summarize findings from experimental and quasi-experimental investigations into the effectiveness of L2 instruction published between 1980 and 1998. Comparisons of average effect sizes from 49 unique sample studies reporting sufficient data indicated that focused L2 instruction results in large target-oriented gains, that explicit types o…
Does Type of Instruction Make a Difference? Substantive Findings From a Meta‐analytic Review
This study employed systematic procedures for research synthesis and meta‐analysis to summarize findings from experimental and quasi‐experimental investigations into the effectiveness of L2 instruction published between 1980 and 1998. Comparisons of average effect sizes from 49 unique sample studies reporting sufficient data indicated that focused L2 instruction results in large target‐oriented gains, that explicit types of instruction are more e…
Interpretations, intended uses and designs in task-based language assessment
Examinee abilities and task difficulty in task-based second language performance assessment
This article summarizes findings from investigations into the development and use of a prototype English language task-based performance test. Data included performances by 90 examinees on 13 complex and skills-integrativetasks, a priori estimations of examinee proficiency differences, a priori estimations of task difficulty based on cognitive processing demands, performance ratings according to task-specific as well as holistic scales and criter…
Exploring the Uses and Usefulness of ACTFL Oral Proficiency Ratings and Standards in College Foreign Language Departments
Oral proficiency ratings, based on the ACTFL Guidelines and derived from live or simulated oral proficiency interviews (SOPIs), enjoy widespread use in the United States. In particular, college foreign language departments have increasingly adopted oral proficiency ratings as a way of establishing standards for language or graduation requirements. In the study reported here, the authors explored the intended uses of proficiency‐based standards in…
Synthesizing Research on Language Learning and Teaching
This volume presents the first collection of work on research synthesis in applied linguistics. It introduces readers to a cutting-edge approach for reviewing and summarizing exactly what accumulated research has to say about theoretical and practical subjects. John Norris and Lourdes Ortega first elucidate the value and practice of synthesis, and they challenge all members of the research community to adopt a “synthetic ethic”. The book then f…
The Future of Research Synthesis in Applied Linguistics: Beyond Art or Science
TESOL Quarterly publishes brief commentaries on aspects of qualitative and quantitative research. This issue features a discussion of research synthesis in applied linguistics
Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity
In this article, we examine current practices in the measurement of syntactic complexity to illustrate the need for more organic and sustainable practices in the measurement of complexity, accuracy, and fluency (CAF) in second language production. Through in-depth review of examples drawn from research on instructed second language acquisition, we identify and discuss challenges to the evidentiary logic that underlies current approaches. We also …
Forthcoming in Language Teaching
An abstract is not available for this content. As you have access to this content, full HTML content is provided on this page. A PDF of this content is also available in through the ‘Save PDF’ action button
Research synthesis
When in the late 1990s we set out to review the accumulated research on second language (L2) instructional effectiveness, it was with a sense – though no certainty – that a journey into the uncharted territory of systematic research synthesis would eventually prove worth the effort. In order to find a fitting methodology, and in the absence of any guidance within applied linguistics, we willingly delved into challenging techniques and debates fro…
Laboratory work in early geoscience: Changing the story
Meta‐Analysis
Meta‐analysis is a secondary research methodology consisting of techniques for reviewing quantitative primary research studies; extracting, combining, and comparing findings; and interpreting what is known about particular questions, variables, or other foci that have generated substantial empirical attention.
EFL/ESL Teaching and Learning (16 works) · Psychology (16 works) · Computer Science (12 works) · History (11 works) · Linguistics (11 works) · Sociology (11 works) · Philosophy (9 works) · Mathematics education (8 works) · Political science (8 works) · Mathematics (7 works)