The Validity and Reliability of Survey Questions
A Meta-Analysis of MTMM Studies
Bibliographic Data
| ID | 2331787 |
|---|---|
| Authors | Annette Scherpenzeel (University of Amsterdam), Annette C Scherpenzeel (University of Amsterdam), Willem E Saris (0000-0002-2513-8589, University of Amsterdam) |
| Year | 1997 |
| Volume | 25 |
| Issue | 3 |
| Pages | 341-383 |
| Publication date | 1997-02-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Sociological Methods & Research (JOURNAL) |
| Journal identifiers | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/0049124197025003004 |
| OpenAlex | W2096102128 |
| Language | EN |
| Citations received | 38 |
| References cited | 19 |
Inspired by the research of Frank Andrews on the reliability and validity of survey questions, a large-scale research project was conducted in the Netherlands. The project was comprised of two different stages. For this project, more than 600 survey questions were included in different surveys according to a multitrait-multimethod design. The resulting data were analyzed in two steps. In the first step, estimates of validity and reliability were obtained for each question. The second step was a meta-analysis of the variation in data quality found in the first step. This variation was related to question-specific characteristics, response scale characteristics, context characteristics, and design characteristics. The article describes how the results of this study can be of practical use. In addition, the authors compare them to results of similar studies in the United States, Austria, and other Western, Central, and Eastern European countries
Cartography · Context (archaeology) · External validity · Geography · Psychometrics · Reliability (semiconductor) · Scale (ratio) · Statistics · Survey research · Validity · Applied Psychology · Computer Science · Mathematics · Psychology · Psychometric Methodologies and Testing · Reliability and Agreement in Measurement · Survey Methodology and Nonresponse
How Much Should We Trust Micro-data? A Comparison of the Socio-demographic Profile of Malawian Households Using Census, LSMS and DHS data
Reliability and Validity Assessment
What Large-Scale, Survey Research Tells Us about Teacher Effects on Student Achievement
Sources of Method Bias in Social Science Research and Recommendations on How to Control It
Cross-national Comparison of the Quality of Life in Europe
A Comparison of the Quality of Questions in a Face-to-face and a Web Survey
Refining the Total Survey Error Perspective
Variations in Response Style Behavior by Response Scale Format in Attitude Research
Examining Variation in Surveying Attitudes on Same-Sex Marriage
Psychometric validation of the Reported and Intended Behaviour Scale (Ribs) in Hungary with a particular focus on ‘Don’t know’ responses and further scoring recommendations
Does government intervention moderate the flood risk, flood risk perceptions, and moral hazard of Malaysian household risk financing decisions
Correcting Correlation and Covariance Matrices for Measurement Errors Before Further Analysis
Number of answer categories for bipolar item specific scales in face-to-face surveys
A new international measure of social stratification
Reporting Mobile Social Media Use
Quality of Different Scales in an Online Survey in Mexico and Colombia
The Bricklayer Effect
Translating Q methodology results into survey questions for large-scale use
Diabetes-related stigma affects the quality of life of people living with diabetes mellitus in Switzerland
Measurement Reliability, Validity, and Quality of Slider Versus Radio Button Scales in an Online Probability-Based Panel in Norway
Nonresponse versus Measurement Error
The Impact of “No Opinion” Response Options on Data Quality
The Kiss Principle in Survey Design
A New Approach to Evaluating the Quality of Measurement Instruments
Stigmatisierungserfahrungen von Menschen mit Diabetes mellitus in der Schweiz
Can Survey Scales Affect What People Report as A Fair Income? Evidence From the Cross-National Probability-Based Online Panel CRONOS
Investigating Response Errors in Survey Data
Measuring the Content of Instruction
Preference-Shaping
Item Similarity in Scale Analysis
The impact of campus housing problems faced by female expatriate students on the level of their academic achievement
How Comparative Is Comparative Research
Generation of an Interval Metric Scale to Measure Attitude
Choosing the Number of Categories in Agree-Disagree Scales
Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions
Validity and Reliability of Subjective Social Indicators
Stability and Change of Well Being
Happiness is not Enough
Statistical Theories of Mental Test Scores
Sociological Methodology, 1992 (Sociological Methodology)
Computer-Assisted Interviewing
Handbook of Survey Research
Statistical Analysis of Sets of Congeneric Tests
Maximum Likelihood Estimation of the Polychoric Correlation Coefficient
Structural Equations with Latent Variables
The Evaluation of Measurement Instruments By Meta-Analysis of Multitrait-Multimethod Studies
Approaches to the Interpretation of Relationships in the Multitrait-Multimethod Matrix
Validity, Invalidity, and Reliability
Significance tests and goodness of fit in the analysis of covariance structures
Construct Validity and Error Components of Survey Measures
Convergent and discriminant validation by the multitrait-multimethod matrix
The Reliability of Survey Attitude Measurement
Structural Equation Models
| Unique citing works | 38 |
|---|---|
| Citations per year | 1,36 |
| Citation span | 1998 - 2026 (29) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 37 |