The Effect of Panel Membership and Feedback on Ratings in a Two-Round Delphi Survey

Results of a Randomized Controlled Trial

Bibliographic Data

ID9100714
AuthorsStephen Campbell (0000-0002-2328-4136, National Computing Centre (United Kingdom), corresponding author), Stephen M Campbell, Mark Hann (0000-0003-4481-4068, corresponding author), Martin Roland (0000-0002-8533-3060, corresponding author), Martin O Roland, Julie Ann Quayle (corresponding author), Paul G Shekelle
Year1999
Volume37
Issue9
Pages964-968
Publication date1999-09-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueMedical Care (JOURNAL)
Journal identifiersISSN: 0025-7079 • E-ISSN: 1537-1948
PublisherOvid Technologies (Wolters Kluwer Health) (PUBLISHER)
DOI10.1097/00005650-199909000-00012
PMID10493474
OpenAlexW2951226105
LanguageEN
Citations received9
References cited19

BACKGROUND: Past observational studies of the RAND/UCLA Appropriateness Method have shown that the composition of panels affects the ratings that are obtained. Panels of mixed physicians make different judgments from panels of single specialty physicians, and physicians who use a procedure are more likely to rate it more highly than those who do not. OBJECTIVES: To determine the effect of using physicians and health care managers within a panel designed to assess quality indicators for primary care and to test the effect of different types of feedback within the panel process. METHOD: A two-round postal Delphi survey of health care managers and family physicians rated 240 potential indicators of quality of primary care in the United Kingdom to determine their face validity. Following round one, equal numbers of managers and physicians were randomly allocated to receive either collective (whole sample) or group-only (own professional group only) feedback, thus, creating four subgroups of two single-specialty panels and two mixed panels. RESULTS: Overall, managers rated the indicators significantly higher than physicians. Second-round scores were moderated by the type of feedback received with those receiving collective feedback influenced by the other professional group. CONCLUSIONS: This paper provides further experimental evidence that consensus panel judgments are influenced both by panel composition and by the type of feedback which is given to participants during the panel process. Careful attention must be given to the methods used to conduct consensus panel studies, and methods need to be described in detail when such studies are reported

Delphi · Delphi method · Family medicine · Health care · Medical Expenditure Panel Survey · Observational study · Panel data · Quality (philosophy) · Sample (material) · Specialty · Statistics · Test (biology) · Computer Science · Delphi Technique in Research · Medicine · Patient Satisfaction in Healthcare · Psychology · Survey Methodology and Nonresponse