Evaluating Patients’ Experiences with Individual Physicians

A Randomized Trial of Mail, Internet, and Interactive Voice Response Telephone Administration of Surveys

Bibliographic Data

ID9102819
AuthorsHector P Rodriguez (0000-0002-6564-2229, Tufts Medical Center, corresponding author), Ted von Glahn (Pacific Business Group on Health), William H Rogers (Tufts University, corresponding author), Hong Chang (0000-0002-2279-437X, Tufts Medical Center, corresponding author), Gary Fanjiang, Dana Gelb Safran (Tufts University, corresponding author)
Year2006
Volume44
Issue2
Pages167-174
Publication date2006-02-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueMedical Care (JOURNAL)
Journal identifiersISSN: 0025-7079 • E-ISSN: 1537-1948
PublisherOvid Technologies (Wolters Kluwer Health) (PUBLISHER)
DOI10.1097/01.mlr.0000196961.00933.8e
PMID16434916
OpenAlexW2104543870
LanguageEN
Citations received16
References cited22

BACKGROUND: There is increasing interest in measuring patients' experiences with individual physicians, and empirical evidence supports this area of measurement. However, the high cost of data collection remains a significant barrier. Survey modes with the potential to lower costs, such as Internet and interactive voice response (IVR) telephone, are attractive alternatives to mail, but their comparative response rates and data quality have not been tested. METHODS: We randomly assigned adult patients from the panels of 62 primary care physicians in California to complete a brief, validated patient questionnaire by mail, Internet (web), or IVR. After 2 invitations, web and IVR nonrespondents were mailed a paper copy of the survey ("crossover" to mail). We analyzed and compared (n = 9126) the response rates, respondent characteristics, substantive responses, and costs by mode (mail, web and IVR) and evaluated the impact of "crossover" respondents. RESULTS: Response rates were higher by mail (50.8%) than web (18.4%) or IVR (34.7%), but after crossover mailings, response rates in each arm were approximately 50%. Mail and web produced identical scores for individual physicians, but IVR scores were significantly lower even after adjusting for respondent characteristics. There were no significant physician-mode interactions, indicating that statistical adjustment for mode resolves the IVR effect. Web and IVR costs were higher than mail. CONCLUSIONS: The equivalence of individual physician results in mail and web modes is noteworthy, as is evidence that IVR results are comparable after adjustment for mode. However, the higher overall cost of web and IVR, as the result of the need for mailings to support these modes, suggests that they do not presently solve cost concerns related to obtaining physician-specific information from patients

Family medicine · Interactive voice response · Respondent · Telecommunications · The Internet · World Wide Web · Computer Science · Health Literacy and Information Accessibility · Medicine · Patient Satisfaction in Healthcare · Psychology · Survey Methodology and Nonresponse