Development and Validation of a Grading System for the Quality of Cost-Effectiveness Studies

Bibliographic Data

ID9101885
AuthorsChiun-Fang Chiou, Chiun‐Fang Chiou (Cerner (United States), corresponding author), Joel W Hay (0000-0002-4467-9997, University of Southern California), Joel F Wallace, Joel Wallace (Sinai Health System, corresponding author), Bernard S Bloom (University of Southern California), Peter J Neumann (0000-0003-1226-4073, Boston University), Shirley Darcus Sullivan (0000-0003-3052-6540, University of Washington), Sean D Sullivan, Hsing-Ting Yu (0009-0009-1279-2977, Sinai Health System, corresponding author), Emmett B Keeler (RAND Corporation), James M Henning (Lake Forest College), Joshua J Ofman (Sinai Health System, corresponding author)
Year2003
Volume41
Issue1
Pages32-44
Publication date2003-01-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueMedical Care (JOURNAL)
Journal identifiersISSN: 0025-7079 • E-ISSN: 1537-1948
PublisherOvid Technologies (Wolters Kluwer Health) (PUBLISHER)
DOI10.1097/00005650-200301000-00007
PMID12544542
OpenAlexW1989654054
LanguageEN
Citations received4
References cited30

PURPOSE: To provide a practical quantitative tool for appraising the quality of cost-effectiveness (CE) studies. METHODS: A committee comprising [corrected] of health economists selected a set of criteria for the instrument from an item pool. Data collected with a conjoint analysis survey on 120 international health economists were used to estimate weights for each criterion with a random effects regression model. To validate the grading system, a survey was sent to 60 individuals with health economics expertise. Participants first rated the quality of three CE studies on a visual analogue scale, and then evaluated each study using the grading system. Spearman rho and Wilcoxon tests were used to detect convergent validity and analysis of covariance (ANCOVA) for discriminant validity. Agreement between the global rating by experts and the grading system was also examined. RESULTS: Sixteen criteria were selected. Their coefficient estimates ranged from 1.2 to 8.9, with a sum of 93.5 on a 100-point scale. The only insignificant criterion was "use of subgroup analyses." Both convergent validity and discriminant validity of the grading system were shown by the results of the Spearman rho (correlation coefficient = 0.78, P < 0.0001), Wilcoxon test (P = 0.53), and ANCOVA (F(3,146) = 5.97, p = 0.001). The grading system had good agreement with global rating by experts. CONCLUSIONS: The instrument appears to be simple, internally consistent, and valid for measuring the perceived quality of CE studies. Applicability for use in clinical and resource allocation decision-making deserves further study

Analysis of covariance · Convergent validity · Discriminant validity · Econometrics · Friedman test · Grading (engineering) · Linear discriminant analysis · Psychometrics · Rating scale · Spearman's rank correlation coefficient · Statistical hypothesis testing · Statistics · Wilcoxon signed-rank test · Economic and Financial Impacts of Cancer · Engineering · Health Systems, Economic Evaluations, Quality of Life · Healthcare cost, quality, practices · Mathematics · Medicine · Psychology

Tools

Open DOISci-Hub