Untapped Potential
Designed Digital Trace Data in Online Survey Experiments
Bibliographic Data
| ID | 2331184 |
|---|---|
| Authors | Erin Macke (0000-0002-1512-1097, Stanford University, corresponding author), Claire Davis (0000-0001-8642-5162, Stanford University), Emma Williams-Baron (0000-0002-2541-5603, Stanford University) |
| Year | 2024 |
| Volume | 55 |
| Issue | 1 |
| Pages | 299-339 |
| Publication date | 2024-08-09 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Sociological Methods & Research (JOURNAL) |
| Journal identifiers | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/00491241241268770 |
| OpenAlex | W4401462885 |
| Language | EN |
| Citations received | 2 |
| References cited | 123 |
Researchers have developed many uses for digital trace data, yet most online survey experiments continue to rely on attitudinal rather than behavioral measures. We argue that researchers can collect digital trace data during online survey experiments with relative ease, at modest costs, and to substantial benefit. Because digital trace data unobtrusively measure survey participants' behaviors, they can be used to analyze digital outcomes of theoretical and empirical interest, while reducing the risk of social desirability bias. We demonstrate the feasibility and utility of collecting digital trace data during online survey experiments through two original studies. In both, participants evaluated interactive digital resumes designed to track participants' clicks, mouse movements, and time spent on the resumes. This novel approach allowed us to better understand participants' search for information and cognitive processing in hiring decisions. There is immense, untapped potential value in collecting digital trace data during online survey experiments and using it to address important sociological research questions
Data science · Digital data · Empirical research · Internet privacy · Statistics · Survey data collection · Survey methodology · Survey research · Telecommunications · TRACE (psycholinguistics) · Applied Psychology · Computer Science · Names, Identity, and Discrimination Research · Psychology · Social and Intergroup Psychology · Survey Methodology and Nonresponse
Bit by Bit
Pedigree
Population-Based Survey Experiments
Predicting consumer behavior with Web search
Detecting influenza epidemics using search engine query data
The Parable of Google Flu
Empirical Analysis of an Evolving Social Network
Spontaneous giving and calculated greed
Realistic precision and accuracy of online experiment platforms, web browsers, and devices
Diffusion Decision Model
The Spread of Behavior in an Online Social Network Experiment
The Diffusion Decision Model
Attention Discrimination
Internet Research in Psychology
Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral Research
Assessing the Russian Internet Research Agency’s impact on the political attitudes and behaviors of American Twitter users in late 2017
Gorilla in our midst
Validity Issues in the Use of Social Network Analysis with Digital Trace Data
Continuous attraction toward phonological competitors
PsychoPy2
A 61-million-person experiment in social influence and political mobilization
The Oxford Handbook of Networked Communication
Construct Validation in Social and Personality Research
Survey research methods
Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination
Privacy in Context
Methods of coping with social desirability bias
Structure of Online Dating Markets in U.S. Cities
Political Ideology and Racial Preferences in Online Dating
Mobile methods
Augmenting Survey and Experimental Designs with Digital Trace Data
No Such Effect? The Implications of Measurement Error in Self-Report Measures of Mobile Communication Use
A functional approach to the Facebook Like button
Measuring Mobile Phone Use
Political Expression and Action on Social Media
Explaining Online News Engagement Based on Browsing Behavior
Two Half-Truths Make a Whole? On Bias in Self-Reports and Tracking Data
Who Is Exposed to News? It Depends on How You Measure
Explaining Response Latencies and Changing Answers Using Client-Side Paradata from a Web Survey
Linking Twitter and Survey Data
Self-Reported Versus Digitally Recorded
Using Passive Data From a Meter to Complement Survey Data in Order to Study Online Behavior
Integrating Survey Data and Digital Trace Data
Combining Big Data and Survey Techniques to Model Effects of Political Content Flows in Facebook
Collecting Survey and Smartphone Sensor Data With an App
Applications and Innovations of Eye‐movement Research in Judgment and Decision Making
Discrimination at the Intersection of Age, Race, and Gender
Understanding and using the Implicit Association Test
Correlating Self-Report and Trace Data Measures of Incivility
Mobile Technologies for Conducting, Augmenting and Potentially Replacing Surveys
Ethical Considerations for Augmenting Surveys with Auxiliary Data Sources
Social Media Analyses for Social Measurement
Measure for Measure
Some Advances in the Design of Survey Experiments
Can You Really Study an Army on the Internet? Comparing How Status Tasks Perform in the Laboratory and Online Settings
Promises and Pitfalls of Using Digital Traces for Demographic Research
Cultural Schemas
Reconnecting Here and There
Taking the Time
From Opt Out to Blocked Out
Class Advantage, Commitment Penalty
Sources of Segregation in Social Networks
Penalized or Protected? Gender and the Consequences of Nonstandard and Mismatched Employment Histories
The Mark of a Woman's Record
Walking the Talk? What Employers Say Versus What They Do
Construct validity in psychological tests
The effect of journal metrics on academic resume assessment
How Censorship in China Allows Government Criticism but Silences Collective Expression
Normative Discrimination and the Motherhood Penalty
Using Location Data From Mobile Phones to Study Participation in Mass Protests
Acceptance of the Automated Online Collection of Geographical Information
Utilizing Smartphones to Study Disadvantaged and Hard-to-Reach Groups
Using Twitter for Demographic and Social Science Research
Taming Big Data
The 'Attitudinal Fallacy' Is a Fallacy
Linking Survey and Administrative Records
Correlates of Obtaining Informed Consent to Data Linkage
Digital Footprints
The Principles of Experimental Design and Their Application in Sociology
Studying the Digital
Do Reputation Systems Undermine Trust? Divergent Effects of Enforcement Type on Generalized Trust and Trustworthiness
Getting a Job
| Unique citing works | 2 |
|---|---|
| Citations per year | 2 |
| Citation span | 2025 - 2025 (1) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 2 |