The Use of Cognitive Testing to Develop and Evaluate CAHPSTM 1.0 Core Survey Items

OBJECTIVES: The main goal of the Consumer Assessments of Health Plans Study (CAHPS) is to develop an integrated set of tested, standardized surveys to obtain meaningful information from health plan enrollees about their experiences. The CAHPS project benefits from the complementary strengths of psychometric and cognitive testing. METHODS: The CAHPS team conducted 150 cognitive interviews across three organizations in different geographic locations using multiple interview methods with different consumer populations. This article explains how cognitive testing was used in the CAHPS survey development process and shares the main findings from the cognitive interviews. RESULTS: A modified report format is more appropriate when asking about specific aspects of plan enrollees' experiences, whereas a rating format is useful for asking about overall assessments. Specifying a longer reference period is preferable to asking about the most recent visit when capturing experiences with care, because some respondents get frustrated when they cannot include experiences other than the most recent visit. Explicit screeners and tailored inapplicable response categories are beneficial in mail questionnaires, so people know that they should not answer questions about which they have no relevant experience. CONCLUSION: Cognitive testing was integral in the development and refinement of the CAHPS instrument. The cognitive testing findings contributed to an improved instrument that should capture consumers' health care and plan experiences with less response error than one not subjected to such testing. The cognitive testing process and findings can be useful to other researchers with similar survey development goals

Cognition · Cognitive test · Plan (archaeology) · Process (computing) · Set (abstract data type) · Applied Psychology · Computer Science · Geriatric Care and Nursing Homes · Patient Satisfaction in Healthcare · Psychology · Survey Methodology and Nonresponse

• Implications of Using Different Measures of Work Shift in Survey Research

  Open Access•Brian W Ward, Brian Ward•Journal of Applied Social Science•2011

  Incluir item

• The use of cognitive interviews to revise the Quality of Trauma Care Patient-Reported Experience Measure (QTAC-PREM)

  Open Access•Niklas Bobrovitz, Maria Santana et al.•Quality of Life Research•2015

  Incluir item

• Are Retrospective Measures of Change in Quality of Life More Valid Than Prospective Measures

  Pythia T Nieuwkerk, Marieke S Tollenaar et al.•Medical Care•2007

  Incluir item

• Adapting Patient Experience Data Collection Processes for Lower Literacy Patient Populations Using Tablets at the Point of Care

  Lina Tieu, Alicia Hobbs et al.•Medical Care•2019

  Incluir item

• Advancing Health Disparities Research

  Anita L Stewart, Anna M Nápoles-Springer et al.•Medical Care•2003

  Incluir item

• Evidence That School-Age Children Can Self-Report on Their Health

  Open Access•Anne W Riley•Ambulatory Pediatrics•2004

  Incluir item

• The value of cognitive interviewing for optimizing a patient experience survey

  Corine Buers, Mattanja Triemstra et al.•International Journal of Social…•2013

  Incluir item

• Evaluating the use of a modified CAHPS® survey to support improvements in patient‐centred care

  Open Access•Elizabeth Davies, Dale Shaller et al.•Health Expectations•2008

  Incluir item

• Care Experiences Among Medicare Beneficiaries With and Without a Personal Physician

  Grant R Martsolf, Marc N Elliott et al.•Medical Care•2018

  Incluir item

• Development of Items to Assess Patients’ Health Literacy Experiences at Hospitals for the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Hospital Survey

  Open Access•Beverly Weidmer, Beverly A Weidmer et al.•Medical Care•2012

  Incluir item

• Using Cognitive Interviews to Develop Surveys in Diverse Populations

  Anna M N??poles-Springer, Anna M N poles-Springer et al.•Medical Care•2006

  Incluir item

• Psychometric Properties of the CAHPSTM 1.0 Survey Measures

  Ron D Hays, James A Shaul et al.•Medical Care•1999

  Incluir item

• Socioeconomic Status and Dissatisfaction Among HMO Enrollees

  Matthew J Carlson, Jan Blustein et al.•Medical Care•2000

  Incluir item

• Translating the CAHPSTM 1.0 Survey Instruments Into Spanish

  Beverly Weidmer, Julie Brown et al.•Medical Care•1999

  Incluir item

• How Do They Compare

  Chunliu Zhan, Judith Sangl et al.•Medical Care•2002

  Incluir item

• Health-Related Quality-of-Life Assessments in Diverse Population Groups in the United States

  Anita L Stewart, Anna Nápoles-Springer et al.•Medical Care•2000

  Incluir item

• Special Issues Addressed in the CAHPSTM Survey of Medicare Managed Care Beneficiaries

  Jenny A Schnaier, Sheri F Sweeny et al.•Medical Care•1999

  Incluir item

• Special Issues in Assessing Care of Medicaid Recipients

  Julie A Brown, Shirley E Nederend et al.•Medical Care•1999

  Incluir item

• Making Survey Results Easy to Report to Consumers

  Jeanne Mcgee, David E Kanouse et al.•Medical Care•1999

  Incluir item

• Development and Evaluation of CAHPS® Survey Items Assessing How Well Healthcare Providers Address Health Literacy

  Open Access•Beverly Weidmer, Beverly A Weidmer et al.•Medical Care•2012

  Incluir item

• Psychometric Properties of the Spanish Consumer Assessment of Health Plans Survey (CAHPS)

  Open Access•Leo S Morales, Robert Weech-Maldonado et al.•Hispanic Journal of Behavioral…•2003

  Incluir item

• Mail and telephone surveys

  Don A Dillman•Mail and telephone surveys•1978

  Incluir item

• Measurement Errors in Surveys

  Open Access•Paul P Biemer, Robert M Groves et al.•Measurement Errors in Surveys•2004

  Incluir item

• Epilogue

  Kristin L Carman, Pamela Farley Short et al.•Medical Care•1999

  Incluir item

• Psychometric Properties of the CAHPSTM 1.0 Survey Measures

  Ron D Hays, James A Shaul et al.•Medical Care•1999

  Incluir item

• Special Issues Addressed in the CAHPSTM Survey of Medicare Managed Care Beneficiaries

  Jenny A Schnaier, Sheri F Sweeny et al.•Medical Care•1999

  Incluir item

• Special Issues in Assessing Care of Medicaid Recipients

  Julie A Brown, Shirley E Nederend et al.•Medical Care•1999

  Incluir item

• The Impact of Having Parents Report About Both Their Own and Their Children's Experiences With Health Insurance Plans

  James A Shaul, Floyd Jackson Fowler et al.•Medical Care•1999

  Incluir item