Mitigating fraud in a fully decentralized clinical trial of a digital health intervention
Bibliographic Data
BACKGROUND: Decentralized clinical trials (DCT), digital survey methodologies, and health monitoring technologies create the potential to reduce study participant burden as well as enhance sample diversity and enrollment pace. However, fraudulent participant activity poses a significant threat to study validity and data integrity. PURPOSE: This study quantifies fraudulent attempts at participation in a DCT of a mobile mental health intervention for problematic substance use and discusses methods to prevent and detect fraudulent activity. METHODS: Adults residing in the US reporting problematic substance use were recruited for a fully remote DCT via 2 primary channels: social media advertisements and survey panels. The DCT offered incentives totaling up to $100 for completing assessments over the 12-week study. To prevent and detect fraudulent activity, the research team utilized VPN and proxy detection, checked for duplicate identifiers (e.g., emails, phone numbers, IP Addresses), and compared age and date of birth (DOB) responses across timepoints. Descriptive statistics and group comparisons across the 2 sources of recruitment methodology were utilized to quantify and characterize fraudulent activity. RESULTS: Of the 2,781 eligible screeners completed, 1,725 (62%) were determined to be fraudulent prior to randomization, detected most commonly by duplicate identifiers (65%) and/or VPN and proxy detection (47%). Of the 258 randomized participants, 51 (20%) were later determined to be fraudulent based upon age and/or DOB mismatch. Notable patterns in fraudulent activity (e.g., 42% of fraudulent screening respondents reported the exact age of 30 years; stylistic formatting of email address accounts) were identified. The fraudulent recruitment rate was higher for social media advertising (85%) than survey panels (26%). CONCLUSIONS: Both social media and survey panel recruitment resulted in high levels of fraudulent activity in a DCT of a mobile mental health intervention. Researchers conducting DCTs and/or online surveys are urged to take several precautions and preventative measures to insulate against fraudulent activity including embedding identity verification procedures in consent processes. Researchers should consider making personal contact with a participant to verify identity as well as remain vigilant for fraudulent activity and its real-time dynamic potential. TRIAL REGISTRATION: NCT04925570.
Alternative medicine · Incentive · Internet privacy · mHealth · Pathology · Protocol (science) · Proxy (statistics) · Psychiatry · Psychological intervention · Computer Science · Electronic Health Records Systems · Ethics in Clinical Research · Medicine · Psychology · Social Media in Health Education
Threats of Bots and Other Bad Actors to Data Quality Following Research Participant Recruitment Through Social Media
Detecting, Preventing, and Responding to “Fraudsters” in Internet Research
Research electronic data capture (Redcap)—A metadata-driven methodology and workflow process for providing translational research informatics support
Identifying Multiple Submissions in Internet Research
An Updated Protocol to Detect Invalid Entries in an Online Survey of Men Who Have Sex with Men (MSM)
Data Quality in HIV/Aids Web-Based Surveys
| Citation velocity | historical |
|---|---|
| Highly cited | No |