Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Measuring Learning Outcomes in Higher Education

Motivation Matters

Bibliographic Data

ID9732149
AuthorsOu Lydia Liu (0000-0001-6296-5092, Educational Testing Service, Princeton, NJ, corresponding author), Brent Bridgeman (0000-0002-2386-8844, Educational Testing Service, Princeton, NJ), Rachel M Adler (Educational Testing Service, Princeton, NJ)
Year2012
Volume41
Issue9
Pages352-362
Publication date2012-12-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational Researcher (JOURNAL)
Journal identifiersISSN: 0013-189X • E-ISSN: 1935-102X
PublisherAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.3102/0013189x12459679
OpenAlexW1979626957
LanguageEN
Citations received26
References cited23

With the pressing need for accountability in higher education, standardized outcomes assessments have been widely used to evaluate learning and inform policy. However, the critical question on how scores are influenced by students’ motivation has been insufficiently addressed. Using random assignment, we administered a multiple-choice test and an essay across three motivational conditions. Students’ self-report motivation was also collected. Motivation significantly predicted test scores. A substantial performance gap emerged between students in different motivational conditions (effect size as large as .68). Depending on the test format and condition, conclusions about college learning gain (i.e., value added) varied dramatically from substantial gain ( d = 0.72) to negative gain ( d = −0.23). The findings have significant implications for higher education stakeholders at many levels

Accountability · Higher education · Mathematics education · Political science · Standardized test · Test (biology · Evaluation of Teaching Practices · Higher Education Research Studies · Motivation and Self-Concept in Sports · Psychology · Social Psychology

  • Teachers’ Perception of Advantages and Disadvantages of Kahoot

    Open Access•Abouzar Rajabpour•English Linguistics Research•2021

  • The Online Learning and Students’ Fear of Covid-19

    Open Access•Farhat Munir, Aizza Anwar et al.•The International Review of…•2021

  • Project-based engineering learning in college

    Open Access•Liang Li Wu, Christian Fischer et al.•SN Social Sciences•2021

  • Shaping tomorrow’s classrooms

    Open Access•Omar J Garcia, Javeed Kittur•Frontiers in Education•2026

  • The Use of the Kahoot! Learning Platform as a Type of Formative Assessment in the Context of Pre-University Education during the Covid-19 Pandemic Period

    Open Access•Florentina Toma, Daniel Constantin Diaconu et al.•Education Sciences•2021

  • Integrating Augmented Reality, Gamification, and Serious Games in Computer Science Education

    Open Access•Georgios Lampropoulos, Euclid Keramopoulos et al.•Education Sciences•2023

  • Epistemic virtue in higher education

    Open Access•Gabe Avakian Orona, Duncan Pritchard et al.•Current Psychology•2024

  • Integrating immersive virtual reality technology in scaffolded game-based learning to enhance low motivation students’ multimodal science learning

    Open Access•Ai-Chu Elisha Ding, Kuo-Ting Huang et al.•Educational Technology Research…•2024

  • Constructive alignment and the learning experience

    Christian Stamov Roßnagel, Noleine Fitzallen et al.•Higher Education Research &…•2021

  • The effect of using Kahoot! for learning – A literature review

    Open Access•Alf Inge Wang, Rabail Tahir•Computers & Education•2020

  • Examining the effects of a diagnostic language test on learning

    Open Access•Jiuliang Li, Noriko Iwashita•The Journal of Educational Research•2025

  • Effort in Low-Stakes Assessments

    Open Access•Yigal Attali•Educational and Psychological…•2016

  • Assessing critical thinking in higher education

    Ou Lydia Liu, Liyang Mao et al.•Assessment & Evaluation in Higher…•2016

  • Comparison of standardized assessment methods

    Natalie Simper, Brian Frank et al.•Assessment & Evaluation in Higher…•2019

  • On the practices and challenges of measuring higher education value added

    Richard J Shavelson, B W Domínguez et al.•Assessment & Evaluation in Higher…•2016

  • Achieving Critical Life Skills with Inquiry-Based Learning in Social Work Education

    Beth Archer-Kuhn, Natalie R Beltrano et al.•Journal of Teaching in Social Work•2024

  • Global competition, coloniality, and the geopolitics of knowledge in higher education

    Riyad A Shahjahan, Clara Morgan•British Journal of Sociology of…•2016

  • An innovative framework for higher education to evaluate learning gain

    Martin Polkinghorne, Helen O’sullivan et al.•Studies in Higher Education•2021

  • A new framework for the design and evaluation of a learning institution's student engagement activities

    Caroline Wilson, Christine Broughan et al.•Studies in Higher Education•2019

  • Exploring differences between international business undergraduates’ conceptual understanding

    Sean Ashley, Harmen Schaap et al.•Studies in Higher Education•2021

  • Governance Architectures in Higher Education Arising from Extra Information on Learning Outcomes

    Open Access•Ian Austin•Higher Education Policy•2019

  • The essence of agricultural education teachers motivational beliefs across career stages

    Open Access•Amanda Bowling, Amber H Rice et al.•Teaching and Teacher Education•2022

  • Decoding motivation in English medium instruction

    Open Access•Ying Zhou, Samantha Curle•Journal of Multilingual and…•2026

  • Performance assessment and standardization in higher education

    Open Access•H Braun•British Journal of Educational…•2019

  • Investigating student learning gains in college

    Katrina Crotts Roohr, Katrina Roohr et al.•Studies in Higher Education•2017

  • On the effects of student interest, self-efficacy, and perceptions of the instructor on flow, satisfaction, and learning outcomes

    Yi Maggie Guo, Yi Guo et al.•Studies in Higher Education•2020

  • Response Time Effort

    Steven L Wise, Xiaojing Kong•Applied Measurement in Education•2005

  • Higher education as a filter

    Open Access•Kenneth J Arrow•Journal of Public Economics•1973

  • Low Examinee Effort in Low-Stakes Assessment

    Steven L Wise, Christine E DeMars•Educational Assessment•2005

  • Setting the Response Time Threshold Parameter to Differentiate Solution Behavior From Rapid-Guessing Behavior

    Open Access•Xiaojing J Kong, Xiaojing Kong et al.•Educational and Psychological…•2007

  • Evidence of Convergent and Discriminant Validity in Three Measures of College Outcomes

    Open Access•Darwin D Hendel•Educational and Psychological…•1991

  • Selecting value-added models for postsecondary institutional assessment

    Jeffrey T Steedle•Assessment & Evaluation in Higher…•2012

  • Validity of psychological assessment

    Samuel Messick•American Psychologist•1995

Unique citing works26
Citations per year2,6
Citation span2016 - 2026 (11)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 26

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae