A Robustness Test Protocol for Applied QCA

Theory and R Software Application

Dados Bibliográficos

ID2331073
AutoresIoana-Elena Oana (0000-0003-1507-8217, European University Institute, autor correspondente), Carsten Q Schneider (0000-0001-5651-4156, Central European University)
Ano2024
Volume53
Fascículo1
Páginas57-88
Data de publicação2024-02-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoSociological Methods & Research (JOURNAL)
Identificadores do periódicoISSN: 0049-1241 • E-ISSN: 1552-8294
EditoraSAGE Publications Inc (PUBLISHER)
DOI10.1177/00491241211036158
OpenAlexW3196659537
IdiomaEN
Citações recebidas46
Referências citadas23

The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency thresholds should all be tested. Second, we introduce the notion of 'sensitivity range' as the range of values for any of these parameters within which the solution formula remains unchanged. Third, we argue that interpreting robustness is more intricate than simply checking if solutions remain unchanged. Beyond sensitivity ranges, researchers should assess robustness by evaluating changes in parameters of fit and the classification of cases as robust, shaky, or possible. Fourth, we enable researchers to perform more than one robustness test at a time by proposing the notions of a 'test set': the overlap between conceptually plausible alternative solutions that can be generated; and of a 'robust core': that part of a QCA solution that withstands the robustness checks. Fifth, we present functionalities implemented in the R package SetMethods that enable researchers to put in practice our proposals. These advancements are integrated into a comprehensive QCA Robustness Test Protocol consisting of three main tests: sensitivity ranges, fit-oriented robustness, and case-oriented robustness. We illustrate the protocol's implementation with an example on high life expectancy across the globe

Robustness (evolution) · Robustness testing · Computer Science · Qualitative Comparative Analysis Research · Software