Assessing the Scientific Knowledge of the General Public
The Effects of Question Format and Encouraging or Discouraging Don’t Know Responses
Bibliographic Data
| ID | 6372126 |
|---|---|
| Authors | Roger Tourangeau, Aaron Maitland, H Yanna Yan |
| Year | 2016 |
| Volume | 80 |
| Issue | 3 |
| Pages | 741-760 |
| Publication date | 2016-01-01 |
| Open Access | No |
| Type | ARTICLE |
| Venue | Public Opinion Quarterly (JOURNAL) |
| Journal identifiers | ISSN: 0033-362X • E-ISSN: 1537-5331 |
| Publisher | Oxford University Press (OUP) (PUBLISHER) |
| DOI | 10.1093/poq/nfw009 |
| OpenAlex | W2400438382 |
| Language | EN |
| Citations received | 7 |
| References cited | 16 |
There is considerable controversy in the literature about how to measure the knowledge of the general public. Much of the past work concerns political knowledge and has focused on two issues—whether don’t know (DK) responses should be encouraged or discouraged and whether the items should take a multiple-choice or open-ended format. Similar questions have been raised about the best way to measure the public’s knowledge of basic science facts, which the National Science Board (NSB) has monitored for more than forty years. The NSB battery consists of eleven items, ten of them true-false items. The introduction to the items encourages DK responses. We carried out an experiment that compared true-false and forced-choice versions of the items; the experiment also compared versions of the questions that discouraged DK responses (thereby increasing guessing), encouraged them (decreasing guessing), or simply omitted a DK option. With a few items, the forced-choice format was harder than the true-false (i.e., fewer respondents answered them correctly), but with others that format was easier, with no overall pattern. Similarly, the reliability, unidimensionality, and validity of scale scores did not differ by question format. By contrast, encouraging DKs improved the reliability, unidimensionality, and validity of the battery relative to the other two DK conditions. We present a model that shows that discouraging DKs (thereby encouraging guesses) improves the measurement of knowledge only when it increases educated guesses more than it increases blind guesses. That apparently is not true for the science knowledge items we examine
Cognitive psychology · Power (physics · Reliability (semiconductor · Scale (ratio · Climate Change Communication and Perception · Psychology · Risk Perception and Management · Survey Methodology and Nonresponse · Social Psychology
Learning to support science
Dismissing “Don’t Know” Responses to Perceived Risk Survey Items Threatens the Validity of Theoretical and Empirical Behavior-Change Research
Race, Criminal Records, and Discrimination Against Job Seekers
The Language of Stigmatization and the Mark of Violence
Separating Science Knowledge from Religious Belief
The Effects of Metacognition in Survey Research
Mechanical Turk and the “Don’t Know” Option
On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha
Response strategies for coping with the cognitive demands of attitude measures in surveys
The measurement of civic scientific literacy
Who Knows? Question Format and Political Knowledge
Don’t Know” Means “Don’t Know
The Impact of “No Opinion” Response Options on Data Quality
The Knowledge Gap
Experimenting with a "Third Way" in Political Knowledge Estimation
An Experimental Comparison of Web and Telephone Surveys
An Experiment on the Measurement of Political Knowledge in Surveys
Should We Take Don't Know for an Answer
Asked and Answered
Reconsidering the Measurement of Political Knowledge
Developing Valid Knowledge Scales
Survey Research
| Citations per year | 0.78 |
|---|---|
| Citation span | 2017 - 2025 (9) |
| Highly cited | No |