Pular para o conteúdo principal

ETHNOS_APP

Início • Busca • Periódicos • Lista 0

Two Quantitative Approaches for Estimating Content Validity

Dados Bibliográficos

ID23366972
AutoresChristine A Wynd (University of Akron College of Nursing), Bruce Schmidt (Cleveland Clinic Akron General), Michelle Atkins Schaefer (914th Combat Support Hospital, Upper Arlington, Ohio)
Ano2003
Volume25
Fascículo5
Páginas508-518
Data de publicação2003-08-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoWestern Journal of Nursing Research (JOURNAL)
Identificadores do periódicoISSN: 0193-9459 • E-ISSN: 1552-8456
EditoraSAGE Publications (PUBLISHER • US)
DOI10.1177/0193945903252998
PMID12955968
OpenAlexW2129698558
IdiomaEN
Citações recebidas61
Referências citadas26

Instrument content validity is often established through qualitative expert reviews, yet quantitative analysis of reviewer agreements is also advocated in the literature.Two quantitative approaches to content validity estimations were compared and contrasted using a newly developed instrument called the Osteoporosis Risk Assessment Tool (ORAT).Data obtained from a panel of eight expert judges were analyzed. A Content Validity Index (CVI) initially determined that only one item lacked interrater proportion agreement about its relevance to the instrument as a whole (CVI = 0.57). Concern that higher proportion agreement ratings might be due to random chance stimulated further analysis using a multirater kappa coefficient of agreement. An additional seven items had low kappas, ranging from 0.29 to 0.48 and indicating poor agreement among the experts. The findings supported the elimination or revision of eight items. Pros and cons to using both proportion agreement and kappa coefficient analysis are examined.

Cohen's kappa · Content (measure theory) · Content analysis · Content validity · Developmental psychology · Inter-rater reliability · Kappa · Psychometrics · Rating scale · Social science · Statistics · Clinical Psychology · Delphi Technique in Research · Health Education and Validation · Mathematics · Psychology · Reliability and Agreement in Measurement

  • The development of the Humor Structure Appreciation Scale and its relation to Sensation Seeking Inventory and Need for Closure Scale

    Open Access•Filip Sulejmanov, Огнен Спасовски et al.•European Journal of Humour Research•2018

  • Design and Implementation Content Validity Study

    Open Access•Vahid Zamanzadeh, Akram Ghahramanian et al.•Journal of Caring Sciences•2015

  • Content Validation of an Instrument for the Assessment of School Teachers’ Levels of Knowledge of Diabetes through Expert Judgment

    Open Access•Trinidad Luque-Vara, Marta Linares-Manrique et al.•International Journal of…•2020

  • Políticas educativas das escolas na tomada de decisão da retenção escolar

    Open Access•Natalie Nóbrega Santos, Vera Cristina Monteiro•Education Policy Analysis Archives•2023

  • Translation, Cross-Cultural Adaptation, and Validation of Measurement Instruments

    Open Access•Paulo Cruchinho, María Dolores López-Franco et al.•Journal of Multidisciplinary…•2024

  • Is the CVI an acceptable indicator of content validity? Appraisal and recommendations

    Open Access•Denise F Polit, Cheryl Tatano Beck et al.•Research in Nursing & Health•2007

  • Evaluation of methods used for estimating content validity

    Open Access•Enas Almanasreh, Rebekah J Moles et al.•Research in Social and…•2019

  • The content validity index

    Open Access•Denise F Polit, Cheryl Tatano Beck•Research in Nursing & Health•2006

  • Portuguese Physical Literacy Assessment Questionnaire (PPLA-Q) for adolescents (15–18 years) from grades 10–12

    Open Access•João Mota, João Filipe Da Silva Figueira Martins et al.•BMC Public Health•2021

  • Development and Validation of an Atrial Fibrillation Knowledge Assessment Tool (Afkat)

    Open Access•Ibrahim Jatau Abubakar, Barbara C Wimmer et al.•International Journal of…•2020

  • Cognitive Reactivity

    Open Access•Shahla Ostovar, Mariani Binti Md Nor et al.•International Journal of Mental…•2016

  • Evaluating Psychometric Properties of the New Teachers’ Perceptions of Collective Efficacy to Handle Bullying Scale (TCEB)

    Open Access•Ana Carolina Reyes‐Rodríguez, Ana Carolina Reyes-Rodríguez et al.•International Journal of…•2021

  • The Assessment of the Psychomotor Profile in Children

    Open Access•Nídia De Amorim, José Parreiral et al.•Children•2022

  • Measuring Food Literacy

    Open Access•Donna Fingland, Courtney Thompson et al.•International Journal of…•2021

  • Multi-Professional Family Support Programme

    Open Access•Bruna Gonzatto de Souza, Luciana de Cássia Nunes Nascimento et al.•International Journal of…•2024

  • Translation, Cross-Cultural Adaptation, and Validation of the Malay-Version of the Factors Influencing Community Willingness to Perform Cardiopulmonary Resuscitation and Use an Automated External Defibrillator Questionnaire

    Open Access•Amsyar Daud, Azmawati Mohammed Nawi et al.•International Journal of…•2022

  • A Short Version of the Physical Activity Enjoyment Scale

    Open Access•Cheng Chen, Susanne Weyland et al.•International Journal of…•2021

  • Development and Validation of a Novel Ultra-Compact and Cost-Effective Device for Basic Hands-On CPR Training

    Open Access•Joseba Rabanales-Sotos, Isabel María Guisado-Requena et al.•International Journal of…•2022

  • Development and psychometric properties of a new social support scale for self-care in middle-aged patients with type II diabetes (S4-MAD)

    Open Access•Shohreh Naderimagham, Shamsaddin Niknami et al.•BMC Public Health•2012

  • Assessing sport commitment

    Open Access•Arthur Ling, Wah Teo et al.•BMC Public Health•2024

  • Development and Validation of a Rapid Assessment Version of the Assessment Survey of Primary Care in China

    Open Access•Chenwen Zhong, Junjie Huang et al.•Frontiers in Public Health•2022

  • Development and validation of cultural competence assessment tool for healthcare professionals, India

    Open Access•Parvathy Balachandran, Vineetha Karuveettil et al.•Frontiers in Public Health•2022

  • Psychometrics of Persian Version of the Ageism Survey Among an Iranian Older Adult Population During Covid-19 Pandemic

    Open Access•Hamid Sharif Nia, Long She et al.•Frontiers in Public Health•2021

  • Development of an instrument on psychosocial adaptation for people living in a disaster-prone area

    Open Access•Lithin Zacharias, Jayakumar Christy et al.•International Journal of Disaster…•2022

  • Teorías implícitas lectoras de futuros docentes de español

    Open Access•Moisés Damián Perales Escudero, Edith Hernández Méndez et al.•Península•2024

  • The Organizational Systems Thinking Scale (OSTS)

    Open Access•Abbas Rezaei Pandari, Masood Rabieh et al.•Systems Research and Behavioral…•2026

  • Guidelines of Serious Game Design for Promoting Reframing

    Open Access•Lanlan Gao, Rupert Ward et al.•Simulation & Gaming•2023

  • Do people see the way things are as they should be? Measuring the individual differences in system justification

    Open Access•Washington Allysson Dantas Silva, Cicero Roberto Pereira•Current Psychology•2023

  • Development of an Instrument to Assess Pre-Service Teachers’ Attitudes on Person-Centered Behavior Toward Students (APBS)

    Open Access•Nadja Teistler•International Journal of…•2021

  • Faculty Online Teaching Effectiveness Scale (Fotes)

    Open Access•Yea-Jyh Chen, Yvonne M Smith et al.•Evaluation and Program Planning•2024

  • Validity and Reliability of the Brazilian Version of the Instrument the Assessment Strategies in Families-Effectiveness (Asf-E)

    Open Access•Fernanda Lise, Eda Schwartz et al.•Texto & Contexto - Enfermagem•2022

  • Elaboração E Validação De Algoritmo Para O Planejamento Da Administração De Medicamentos Intravenosos Em Neonatos

    Open Access•Anna Caroline Leite Costa, Léia Arcanjo Mendes et al.•Texto & Contexto - Enfermagem•2024

  • Development and Validity of an Algorithm for Planning Intravenous Medication Administration in Infants

    Open Access•Anna Caroline Leite Costa, Léia Arcanjo Mendes et al.•Texto & Contexto - Enfermagem•2024

  • Teachers' occupational health

    Open Access•Gülnar Özyildirim•Psychology in the Schools•2024

  • Development and Preliminary Validation of the Mentalizing Vignettes Task

    Sheetal Lakhani, Poornima Bhola et al.•Journal of Personality Assessment•2025

  • Brr! It’s cold in here” measures of household energy insecurity for the United States

    Open Access•Amanda J Harker Steele, John C Bergstrom•Energy Research & Social Science•2021

  • Assessing the capabilities of resilience against earthquake in the city of Yasuj, Iran

    Amir Bastaminia, Masoud Safaeepour et al.•Environmental Hazards•2018

  • Content Validation of the D-Three Effect Inventory (DTEI)

    Open Access•Idara R Essien-Wood, J Luke Wood•Journal of African American Studies•2020

  • Content Validation of the Organizational Climate for Research Integrity (Ocri) Survey

    Open Access•Carol R Thrush, Jim Vander Putten et al.•Journal of Empirical Research on…•2007

  • Measuring Aspects of Multisexuality

    Ilias Kassaras, Panagiotis Kordoutis•Journal of Bisexuality•2024

  • Impact of Credit Constraints on Financial Performance of Small and Medium Size Enterprises

    Open Access•Terence Achiangea Aminkeng, Huaming Song et al.•European Journal of Development…•2024

  • Religious Barriers to Health for Members of the Bronx Ghanaian Immigrant Muslim Community in New York City

    Open Access•Adam A Musah, Ronald P Hudak•Journal of Religion and Health•2016

  • Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research

    Open Access•Godfred O Boateng, Torsten B Neilands et al.•Frontiers in Public Health•2018

  • Development and psychometric properties of fear of rejection scale (FRS)

    Open Access•Rowaida Yawar, Muhammad Aqeel et al.•International Journal of Human…•2021

  • Court-level stakeholders’ reunification decisions and perceived role in parents’ readiness to support early emotional development post-abuse and/or neglect

    Open Access•Nicole Megan Edwards•Journal of Public Child Welfare•2024

  • Establishing Content-Related Validity Evidence for Assessments in Counseling

    Open Access•Hulya Ermis-Demirtas•International Journal for the…•2018

  • Development and Psychometric Testing of a Scale to Measure Sexual Minority-Inclusivity in Sex Education (SMISES)

    Open Access•Elizabeth Anne McKay, Matias Placencio‐Castro et al.•Sexuality Research and Social…•2023

  • Assessment of Hope in Pediatric Oncology

    Open Access•Laurine Milville, Pascal Antoine et al.•Health Expectations•2025

  • Desenvolvimento de um instrumento quantitativo para inspeção sanitária em serviços de alimentação e nutrição, Brasil

    Open Access•Lilian Monteiro Ferrari Viterbo, Maria Alzira Pimenta Dinis et al.•Ciência & Saúde Coletiva•2020

  • Aplicativo de apoio à doação de sangue

    Open Access•Joélia Rodrigues da Silva, Christina Cesar Praça Brasil et al.•Ciência & Saúde Coletiva•2021

  • Construção de instrumentos de medida na área da saúde

    Open Access•Marina Zambon Orpinelli Coluci, Neusa Maria Costa Alexandre et al.•Ciência & Saúde Coletiva•2015

  • Equivalência semântica, conceitual e de itens do Observable Indicators of Nursing Home Care Quality Instrument

    Open Access•Wagner Ivan Fonseca De Oliveira, Pedro Jesus Saturno Hernández et al.•Ciência & Saúde Coletiva•2016

  • Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas

    Open Access•Neusa Maria Costa Alexandre, Marina Zambon Orpinelli Coluci•Ciência & Saúde Coletiva•2011

  • Developing and validating a nutrition knowledge questionnaire

    Open Access•Gina Louise Trakman, Gina Trakman et al.•Public Health Nutrition•2017

  • Adolescent eating autonomy survey development and exploratory factor analysis

    Open Access•Amanda M Ziegler, Lori A Hatzinger et al.•Appetite•2026

  • Cross-cultural adaptation and validation of the teamwork climate scale

    Open Access•Mariana Charantola Silva, Marina Peduzzi et al.•Revista de Saúde Pública•2016

  • Cross-Cultural Adaptation, Validity and Reliability of the Escala Pessoal de Resultados

    Open Access•Cristina Simões, Sofia Santos•Social Indicators Research•2014

  • Is Seeing believing

    Megan M Parry, Lisa M Dario et al.•Deviant Behavior•2021

  • Music therapy for young children with acquired communication impairments

    Open Access•J Burns, Rebecca O’connor et al.•Nordisk Tidsskrift for Musikkterapi•2024

  • Conceções e práticas de ensino-aprendizagem

    Open Access•Marco Paulo Maia Ferreira•Revista Brasileira de Educação•2023

  • Validity based on content

    Open Access•Juan Pablo Zapata-Ospina, Jenny García-Valencia•Journal of Health Psychology•2022

  • Nonparametric statistics for the behavioral sciences

    Sidney Siegel•Nonparametric statistics for the…•1988

  • Reliability and Validity Assessment

    Edward Carmines, Edward G Carmines et al.•Reliability and Validity Assessment•1979

  • Considerations in the Choice of Interobserver Reliability Estimates

    Open Access•Donald P Hartmann•Journal of Applied Behavior…•1977

  • Interrater reliability and agreement of subjective judgments.

    Howard E A Tinsley, Howard E Tinsley et al.•Journal of Counseling Psychology•1975

  • Instrument review

    Open Access•Linda Lindsey Davis•Applied Nursing Research•1992

  • Determination and Quantification Of Content Validity

    Mary R Lynn•Nursing Research•1986

  • The Measurement of Observer Agreement for Categorical Data

    J R Landis, Gary G Koch•Biometrics•1977

  • A Coefficient of Agreement for Nominal Scales

    Open Access•Jacob Cohen•Educational and Psychological…•1960

  • Relationship Between Two Expressions of Reliability

    Open Access•James A Wakefield•Educational and Psychological…•1980

  • Discrete Multivariate Analysis

    James R Beniger, Yvonne M M Bishop et al.•Contemporary Sociology A Journal…•1975

  • Issues in the Use of Kappa to Estimate Reliability

    Karen L Soeken, Patricia A Prescott•Medical Care•1986

  • Measuring nominal scale agreement among many raters

    Joseph L Flei, Joseph L Fleiss•Psychological Bulletin•1971

Obras citantes distintas61
Citações por ano3,05
Intervalo de citações2006 - 2026 (21)
Velocidade de citaçãocurrent
Altamente citadoNão
Tipos de citaçãoNeutras: 57
Ethnos_APP • Projeto Open Source • Licença MIT • Frontend v2.0.0 • Privacidade e Cookies • Documentação da API: api.ethnos.app/docs • Código da API: GitHub • DOI: 10.5281/zenodo.17049435 • Código do Frontend: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae