Understanding Data Quality through Reliability
A Comparison of Data Reliability Assessment in Three International Relations Datasets
Bibliographic Data
| ID | 12693433 |
|---|---|
| Authors | Steven B Rothman (0000-0003-0383-533X, corresponding author) |
| Year | 2007 |
| Volume | 9 |
| Issue | 3 |
| Pages | 437-456 |
| Publication date | 2007-09-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | International Studies Review (JOURNAL) |
| Journal identifiers | ISSN: 1468-2486 • E-ISSN: 1521-9488 |
| Publisher | Oxford University Press (OUP) (PUBLISHER) |
| DOI | 10.1111/j.1468-2486.2007.00698.x |
| OpenAlex | W2148763022 |
| Language | EN |
| Citations received | 8 |
| References cited | 32 |
Although recent data creation efforts in international relations have begun to focus on issues of reliability and validity more explicitly than previously, current efforts still contain significant problems. This essay focuses on three recent data generation projects that study international relations (the ICOW, ATOP, and River Treaty datasets) and shows the successes and failures of each in assessing reliability when generating data from qualitative evidence. All three datasets attempt to generate reliable data, document the procedures used, and present indications of data reliability. However, their efforts face problems when assessing the reliability of their case selection variables, in the development of reliability indicators, and in the presentation of reliability statistics. In addition to evaluating these recent efforts to generate large-N databases, this essay clarifies the difference between generating data from qualitative and quantitative evidence, explains the importance of reliability when coding qualitative evidence, and provides ways to improve the assessment of the quality of one's data
Coding (social sciences · Data mining · Data quality · Data science · Machine learning · Qualitative property · Quality (philosophy · Reliability (semiconductor · Statistics · Computer Science · Engineering · Evaluation and Performance Assessment · Mathematics · Peacebuilding and International Security · Qualitative Comparative Analysis Research
Information Effects and Human Rights Data
Using the literature to create a scale
The sound of silence
Events Data as Bismarck's Sausages? Intercoder Reliability, Coders' Selection, and Data Quality
Event Data on Armed Conflict and Security
Who did what for whom?’ Amnesty International’s Urgent Actions as activist-generated data
Implications of hydro-political dependency for international water cooperation and conflict
Military Intervention by Powerful States, 1945-2003
Educational measurement.
Reliability and Validity Assessment
The Content Analysis Guidebook
I Nternational E Nvironmental a Greements
Measurement reliability and agreement in psychiatry
Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories
Content Analysis for the Social Sciences and Humanities
Correlates of War
My Current Thoughts on Coefficient Alpha and Successor Procedures
A Coefficient of Agreement for Nominal Scales
Multiple Indicators
Measuring the Typicality of Text
Content Analysis in Mass Communication
Coefficient alpha and the internal structure of tests
Content Analysis. A Technique for Systematic Inference from Communications
The Measurement Characteristics of Congressional Roll-Call Indexes
The Steps to War
Global Regime Formation or Complex Institution Building? The Principled Content of International River Agreements
The Methodology of Necessary Conditions
Oh Monsieur Pasteur, We Hardly Knew You
Social Science Concepts
Convergent and discriminant validation by the multitrait-multimethod matrix
Tracking Democracy's Third Wave with the Polity III Data
Measurement Validity
Reliability in Coding Open-Ended Data
| Citations per year | 0.47 |
|---|---|
| Citation span | 2009 - 2022 (14) |
| Highly cited | No |