Saltar al contenido principal

ETHNOS_APP

Inicio • Búsqueda • Revistas • Lista 0

The Interplay of Evidence and Consequences in the Validation of Performance Assessments

Datos Bibliográficos

ID9734663
AutoresSamuel Messick (Educational Testing Service, Princeton, NJ 08541. He specializes in educational and psychological measurement, and cognition and personality., autor de correspondencia)
Año1994
Volumen23
Número2
Páginas13
Fecha de publicación1994-03-01
Peer ReviewedSí
Open AccessNo
TipoARTICLE
RevistaEducational Researcher (JOURNAL)
Identificadores de la revistaISSN: 0013-189X • E-ISSN: 1935-102X
EditorialAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.2307/1176219
OpenAlexW4237523428
IdiomaEN
Citas recibidas197
Referencias citadas21

Authentic and direct assessments of performances and products are examined in the light of contrasting functions and purposes having implications for validation, especially with respect to the need for specialized validity criteria tailored for performance assessment. These include contrasts between performances and products, between assessment of performance per se and performance assessment of competence or other constructs, between structured and unstructured problems and response modes, and between breadth and depth of domain coverage. These distinctions are elaborated in the context of an overarching contrast between task-driven and construct-driven performance assessment. Rhetoric touting performance assessments because they eschew decomposed skills and decontextualized tasks is viewed as misguided, in that component skills and abstract problems have a legitimate place in pedagogy. Hence, the essence of authentic assessment must be sought elsewhere, that is, in the quest for complete construct representation. With this background, the concepts of “authenticity” and “directness” of performance assessment are treated as tantamount to promissory validity claims that they offset, respectively, the two major threats to construct validity, namely, construct underrepresentation and construct-irrelevant variance. With respect to validation, the salient role of both positive and negative consequences is underscored as well as the need, as in all assessment, for evidence of construct validity

Cognitive psychology · Competence (human resources · Construct (python library · Construct validity · Context (archaeology · Developmental psychology · Psychometrics · Salient · Artificial Intelligence · Computer Science · Educational and Psychological Assessments · Evaluation and Performance Assessment · Human Resource Development and Performance Evaluation · Innovative Education and Learning Practices · Psychology · Social Psychology · Student Assessment and Feedback

  • Intradisciplinariedad e Interdisciplinariedad en la adquisición de competencias

    Open Access•Pere Lavega Burgués, Pere Lavega-Burgués et al.•Revista Electrónica Interuniversita…•2013

  • Critical Language Testing on Pragmatics Tests

    Yasuhiro Fujiwara•Asian Englishes•2007

  • Uses of Language Assessments

    Open Access•Annie Brown•Encyclopedia of Applied Linguistics•2012

  • Content Validity

    Open Access•Linda Crocker•International Encyclopedia of the…•2015

  • Jahrbuch der berufs- und wirtschaftspädagogischen Forschung 2014

    Open Access•Jürgen Seifried, Uwe Faßhauer et al.•Jahrbuch der berufs- und…•2014

  • Language Testing and Validation

    Open Access•C WEIR, Cyril J Weir•Language Testing and Validation•2005

  • Building a Conceptual Framework for Data Literacy

    Open Access•Edith S Gummer, Edith Gummer et al.•Teachers College Record The Voice…•2015

  • Building and Supporting a Case for Test Use

    Lyle F Bachman•Language Assessment Quarterly•2005

  • Assessing professional competence

    Open Access•Cees P M Van Der Vleuten, Cees Van Der Vleuten et al.•Medical Education•2005

  • Assessment in the age of artificial intelligence

    Open Access•Zachari Swiecki, Hassan Khosravi et al.•Computers and Education:…•2022

  • Culturally Responsive Evaluation

    Stafford Hood, Rodney K Hopson et al.•Handbook of Practical Program…•2015

  • Programmatic assessment

    Lambert Schuwirth, Lambert W T Schuwirth et al.•Medical Teacher•2011

  • Focus Article

    Robert J Mislevy, Linda S Steinberg et al.•Measurement: Interdisciplinary…•2003

  • Standards of Validity and the Validity of Standards in Performance Asessment

    Open Access•Samuel Messick•Educational Measurement: Issues…•1995

  • Implications of Evidence‐Centered Design for Educational Testing

    Open Access•Robert J Mislevy, Geneva D Haertel•Educational Measurement: Issues…•2006

  • Assessing Multilingual Competencies

    Open Access•Elana Shohamy•Modern Language Journal•2011

  • Validating the Interpretations and Uses of Test Scores

    Open Access•Michael T Kane•Journal of Educational Measurement•2013

  • Recovering a Dialectical View of Rationality

    Open Access•Pamela Mo, Pamela A Moss et al.•Social Indicators Research•1998

  • Designing an educational game framework with multi-scaffolding mechanism to facilitate communication and contextual analysis skills

    Open Access•Shu-Wei Liu, Huei‐Tse Hou•Thinking Skills and Creativity•2026

  • Examining the relevance of three Toefl Essentials writing tasks to the accounting profession

    Open Access•Ute Knoch, Jason Fan et al.•Assessing Writing•2026

  • The Assessment Evaluation Rubric

    Open Access•Rochelle E Tractenberg•Education Sciences•2021

  • Validating items of different modalities to assess the educational technology competency of pre-service teachers

    Open Access•Yue Wang, Hong Lu•Computers & Education•2021

  • Prospects for development of culturally inclusive models for education

    Open Access•Matias Urrutia-Jorde•Frontiers in Education•2025

  • Performance Assessment of Critical Thinking

    Open Access•H Braun, Richard J Shavelson et al.•Frontiers in Education•2020

  • Development and Evaluation of a Framework for the Performance-Based Testing of ICT Skills

    Open Access•Lena Engelhardt, J Naumann et al.•Frontiers in Education•2021

  • A data-driven multidimensional assessment model for English listening and speaking courses in higher education

    Open Access•Shuwei Xue, Xin Xue et al.•Frontiers in Education•2023

  • Examining the Validity of Adaptive Comparative Judgment for Peer Evaluation in a Design Thinking Course

    Open Access•Nathan Mentzer, Wonki Lee et al.•Frontiers in Education•2021

  • Occupational Safety and Health as Assessable Transversal Competence in Higher Education

    Open Access•Sorin M Radu, Daniel Onuț Badea et al.•Education Sciences•2026

  • Educational Measurement with Emerging Technologies

    Open Access•Linwei Yu, Gary K W Wong et al.•Education Sciences•2026

  • Designing Culturally Responsive Online Assessments for Equity-Deserving Students

    Open Access•Kim Koh•Cultural and Pedagogical Inquiry•2023

  • A critical view of National Senior Certificate examination discourse and First Additional Language writing tests

    Michelle Bedeker•Southern African Linguistics and…•2024

  • Development of a test taker-oriented rubric

    Open Access•Beverly Baker, Beverly A Baker et al.•Journal of Second Language Writing•2020

  • Item response analysis of computational thinking practices

    Open Access•Siu Cheung Kong, Yi Qing Wang•Computers in Human Behavior•2021

  • Stealth assessment of creativity in a physics video game

    Open Access•Valerie J Shute, Seyedahmad Rahimi•Computers in Human Behavior•2021

  • Multimodal digital classroom assessments

    Open Access•Henning Fjørtoft•Computers & Education•2020

  • Assessing information problem solving through a simulation game

    Open Access•Aranka Bijl, Sebastiaan de Klerk et al.•Computers & Education•2026

  • ‘Time to figure out what to do’

    Open Access•Paula Lehane, Darina Scully et al.•Irish Educational Studies•2022

  • Workplace‐based assessments in postgraduate medical education

    Open Access•Shaun Prentice, Jill Benson et al.•Medical Education•2020

  • A closer look at a marginalized test method

    Open Access•Paula Winke, Xiaowan Zhang et al.•Studies in Second Language…•2023

  • Competency model development

    Open Access•Seyedahmad Rahimi, Russell G Almond et al.•Journal of Computer Assisted…•2024

  • Programmatic assessment for learning

    Dario Torre, Lambert Schuwirth•Medical Teacher•2025

  • How much is enough? Proposing achievement thresholds for core EPAs of graduating medical students in Canada

    Adrian Harvey, Michael Paget et al.•Medical Teacher•2023

  • Psychometric Properties of Measures to Assess Pre‐School Children's Literacy and Mathematics Developmental Skills

    Open Access•Chuang Wang, Qiao Liu et al.•European Journal of Education•2026

  • A comparative study of reading sections of high-stakes teacher-made tests in Portugal

    Open Access•Margarida Pato•Cadernos de Linguagem e Sociedade•2026

  • Assessment validity and learning analytics as prerequisites for ensuring student‐centred learning design

    Open Access•Blazenka Divjak, Barbi Svetec et al.•British Journal of Educational…•2023

  • Video-based mind maps in higher education

    Open Access•Charlotte Beal, Magnus Hontvedt•Learning Culture and Social…•2023

  • Validation of a bilingual version of the vocabulary size test

    Hossein Karami, Mohammadhossein Kouhpaee Nejad et al.•International Journal of…•2020

  • Linking validity and ethics in language testing

    Open Access•Thomas A Schwandt, Eunice Eunhee Jang•Studies In Educational Evaluation•2004

  • Assessing assessment quality

    Open Access•Harm Tillema, Martijn J M Leenknecht et al.•Studies In Educational Evaluation•2011

  • The wheel of competency assessment

    Open Access•Liesbeth Baartman, Liesbeth K J Baartman et al.•Studies In Educational Evaluation•2006

  • Recognizing competence — evaluation of an alternative teacher licensing assessment program

    Open Access•Harm Tillema, Christel Verberg•Studies In Educational Evaluation•2002

  • Iran’s university admission programme at change

    Open Access•Parvaneh Shayestefar, Parvaneh Shayeste-Far et al.•Studies In Educational Evaluation•2018

  • Perceived effects and uses of the national teacher evaluation system in Chilean elementary schools

    Open Access•Sandy Taut, Maria Veronica Santelices et al.•Studies In Educational Evaluation•2011

  • The challenge of maintaining the integrity of reform mathematics in large-scale assessment

    Open Access•Christine Suurtamm, Alex Lawson et al.•Studies In Educational Evaluation•2008

  • Learning from portfolios

    Open Access•Harm H Tillema, Harm Tillema et al.•Studies In Educational Evaluation•2000

  • Validity issues in standard-setting studies

    Open Access•Hans Anand Pant, André A Rupp et al.•Studies In Educational Evaluation•2009

  • Relations Between Student Perceptions of Assessment Authenticity, Study Approaches and Learning Outcome

    Open Access•J T M Gulikers, Theo Bastiaens et al.•Studies In Educational Evaluation•2006

  • In search of quality criteria in peer assessment practices

    Open Access•Karin Ploegh, Harm H Tillema et al.•Studies In Educational Evaluation•2009

  • Comparing student science performance between hands-on and traditional item types

    Open Access•Shaohui Chi, Xiufeng Liu et al.•Studies In Educational Evaluation•2021

  • Developer, teacher, student and employer evaluations of competence-based assessment quality

    Open Access•J T M Gulikers, J Gulikers et al.•Studies In Educational Evaluation•2009

  • New lines in edumetrics

    Open Access•Sabine Dierick, Filip Dochy•Studies In Educational Evaluation•2001

  • Determining the Quality of Competence Assessment Programs

    Open Access•Liesbeth Baartman, Liesbeth K J Baartman et al.•Studies In Educational Evaluation•2007

  • Validity inquiry process

    Open Access•Cynthia A Conn, Kathy J Bohan et al.•Studies In Educational Evaluation•2020

  • Performance assessment in the Third International Mathematics and Science Study — An international perspective

    Open Access•Maryellen Harmon•Studies In Educational Evaluation•1999

  • Teacher licensing examinations—True progress or an illusion

    Open Access•Zipora Libman•Studies In Educational Evaluation•2009

  • Evaluating the Assessment

    Open Access•Menucha Birenbaum•Studies In Educational Evaluation•2007

  • Confirmatory Factor Analysis of the TerraNova Comprehensive Tests of Basic Skills/5

    Open Access•Joseph J Stevens, Keith Zvoch•Educational and Psychological…•2007

  • Assessing Student Performance in the ESL Classroom

    J Charles Alderson, Caroline Clapham•TESOL Quarterly•1995

  • Culturally Responsive Performance-Based Assessment

    Stafford Hood•The Journal of Negro Education•1998

  • Introduction and Overview

    Stafford Hood•The Journal of Negro Education•1998

  • Addressing Cultural Context in the Development of Performance-Based Assessments and Computer-Adaptive Testing

    Gwyneth M Boodoo•The Journal of Negro Education•1998

  • Performance assessment and standardization in higher education

    Open Access•H Braun•British Journal of Educational…•2019

  • Assessment of Complex Performances in Digital Environments

    Open Access•John T Behrens, Kristen E DiCerbo et al.•The Annals of the American…•2019

  • Establishing the validity and reliability of course evaluation questionnaires

    David Kember, Doris Y P Leung•Assessment & Evaluation in Higher…•2008

  • To Control or Not to Control

    David Kember•Assessment & Evaluation in Higher…•2003

  • A Mastery Rubric

    Rochelle E Tractenberg, Jason G Umans et al.•Assessment & Evaluation in Higher…•2010

  • Diffusion of Crime Control Benefits

    Open Access•Ronald V Clarke, Christine A Espin et al.•Journal of Learning Disabilities•2006

  • Celebrating the achievements of sex and relationship peer educators

    Debbie Morgan, Jonathan Robbins et al.•Sex Education•2004

  • Validating score interpretations and uses

    Open Access•Michael T Kane, Michael Kane•Language Testing•2012

  • Investigating variability in tasks and rater judgements in a performance test of foreign language speaking

    Open Access•Lyle F Bachman, Brian K Lynch et al.•Language Testing•1995

  • Washback, impact and validity

    Open Access•Liz Hamp-Lyons, LIZ HAMP‐LYONS•Language Testing•1997

  • Design and analysis in task-based language assessment

    Open Access•Robert J Mislevy, Linda S Steinberg et al.•Language Testing•2002

  • Topical knowledge in L2 speaking assessment

    Open Access•Heng‐Tsung Danny Huang, Heng-Tsung Danny Huang et al.•Language Testing•2018

  • In search of the ethical test

    Open Access•Brian K Lynch•Language Testing•1997

  • Interpretations, intended uses and designs in task-based language assessment

    Open Access•John M Norris•Language Testing•2002

  • Revising the revised format of the ACTFL Oral Proficiency Interview

    Open Access•Rafael Salaberry•Language Testing•2000

  • Modern language testing at the turn of the century

    Open Access•Lyle F Bachman•Language Testing•2000

  • Testing tasks

    Open Access•Glenn Fulcher•Language Testing•1996

  • Some reflections on task-based language performance assessment

    Open Access•Lyle F Bachman•Language Testing•2002

  • Working for washback

    Open Access•Kathleen M Bailey•Language Testing•1996

  • Validity and washback in language testing

    Open Access•Samuel Messick•Language Testing•1996

  • Examinee abilities and task difficulty in task-based second language performance assessment

    Open Access•John M Norris, James Dean Brown et al.•Language Testing•2002

  • Outcomes-based assessment and reporting in language learning programmes

    Open Access•Geoff Brindley•Language Testing•1998

  • “Language,” “communication,” and the longing for the authentic in LSP testing

    Open Access•Barbara Hoekje, Barbara J Hoekje•Language Testing•2016

  • Portfolio assessment

    Ane Qvortrup, Tina Bering Keiding•Assessment & Evaluation in Higher…•2015

  • How convincing is alternative assessment for use in higher education

    Effie Maclellan•Assessment & Evaluation in Higher…•2004

  • Factors influencing assessment quality in higher vocational education

    Liesbeth Baartman, Judith Gulikers et al.•Assessment & Evaluation in Higher…•2013

  • Applying the many‐facet Rasch model to evaluate PowerPoint presentation performance in higher education

    Ramazan Baştürk•Assessment & Evaluation in Higher…•2008

  • Beyond translation

    Rebecca Schendel, Andrew Tolmie•Assessment & Evaluation in Higher…•2017

  • Giving voice to women students

    Open Access•Maria Rae, Jeanne Tai et al.•Assessment & Evaluation in Higher…•2025

  • Perception and the Representative Design of Psychological Experiments

    Egon Brunswik•Perception and the Representative…•1956

  • Shifting Conceptions of Validity in Educational Measurement

    Open Access•Pamela A Moss, Pamela Moss•Review of Educational Research•1992

  • Frames of mind

    Howard Gardner•Frames of mind•1983

  • Syntactic Structures

    Noam Chomsky•Syntactic Structures•1957

  • The theory of multiple intelligences

    Open Access•H Gardner•Annals of Dyslexia•1987

  • The standard problem

    Samuel Messick•American Psychologist•1975

  • The real test bias

    Norman Frederiksen•American Psychologist•1984

  • Validity of Test Interpretation and Use

    Open Access•Samuel Messick•ETS Research Report Series•1990

  • Evidence and Ethics in the Evaluation of Tests

    Open Access•Samuel Messick•Educational Researcher•1981

  • A Systems Approach to Educational Testing

    John R Frederiksen, Alan Collins et al.•Educational Researcher•1989

  • Complex, Performance-Based Assessment

    Open Access•Robert L Linn, Eva L Baker et al.•Educational Researcher•1991

  • Interview on Assessment Issues with Lorrie Shepard

    Lorrie A Shepard, Lorrie Shepard et al.•Educational Researcher•1991

  • The organization of human abilities

    Lloyd G Humphreys•American Psychologist•1962

  • Personality measurement and the ethics of assessment

    Samuel Messick•American Psychologist•1965

  • Intelligence? Creativity? A Parsimonious Reinterpretation of the Wallach-Kogan Data

    Open Access•Lee J Cronbach•American Educational Research…•1968

  • Beyond IQ

    Ann M Clarke, Robert J Sternberg•British Journal of Educational…•1986

  • Construct validity

    Susan E Whitely•Psychological Bulletin•1983

Obras citantes distintas178
Citas por año6,16
Intervalo de citas1994 - 2026 (33)
Velocidad de citacióncurrent
Altamente citadoSí
Tipos de citaNeutras: 194
Ethnos_APP • Proyecto Open Source • Licencia MIT • Frontend v2.0.0 • Privacidad y Cookies • Documentación de la API: api.ethnos.app/docs • Código de la API: GitHub • DOI: 10.5281/zenodo.17049435 • Código del Frontend: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae