Jesse Chandler
Biographic Data
| ID | 3915017 |
|---|---|
| NAME | Jesse Chandler |
| GIVEN NAMES | Jesse |
| FAMILY NAME | Chandler |
| SIGNATURE | CHANDLER J |
| AFFILIATIONS | University of Michigan, Ann Arbor, MI, USA |
| VERIFIED | No |
| TOTAL WORKS | 14 |
| TOTAL CITATIONS | 150 |
| AUTHOR COUNT | 14 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 2008 |
| LATEST PUBLICATION YEAR | 2019 |
| H-INDEX | 4 |
Online panels in social science research: Expanding sampling methods beyond Mechanical Turk
Amazon Mechanical Turk (MTurk) is widely used by behavioral scientists to recruit research participants. MTurk offers advantages over traditional student subject pools, but it also has important limitations. In particular, the MTurk population is small and potentially overused, and some groups of interest to behavioral scientists are underrepresented and difficult to recruit. Here we examined whether online research panels can avoid these limitat…
Likeableness and meaningfulness ratings of 555 (+487) person-descriptive words
Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection
The online labor market Amazon Mechanical Turk (MTurk) is an increasingly popular source of respondents for social science research. A growing body of research has examined the demographic composition of MTurk workers as compared with that of other populations. While these comparisons have revealed the ways in which MTurk workers are and are not representative of the general population, variations among samples drawn from MTurk have received less…
Conducting Clinical Research Using Crowdsourced Convenience Samples
Crowdsourcing has had a dramatic impact on the speed and scale at which scientific research can be conducted. Clinical scientists have particularly benefited from readily available research study participants and streamlined recruiting and payment systems afforded by Amazon Mechanical Turk (MTurk), a popular labor market for crowdsourcing workers. MTurk has been used in this capacity for more than five years. The popularity and novelty of the pla…
The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate i…
Using Nonnaive Participants Can Reduce Effect Sizes
Although researchers often assume their participants are naive to experimental materials, this is not always the case. We investigated how prior exposure to a task affects subsequent experimental results. Participants in this study completed the same set of 12 experimental tasks at two points in time, first as a part of the Many Labs replication project and again a few days, a week, or a month later. Effect sizes were markedly lower in the second…
Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Mechanical Turk (MTurk), an online labor market created by Amazon, has recently become popular among social scientists as a source of survey and experimental data. The workers who populate this market have been assessed on dimensions that are universally relevant to understanding whether, why, and when they should be recruited as research participants. We discuss the characteristics of MTurk as a participant pool for psychology and other social s…
Investigating Variation in Replicability: A “Many Labs” Replication Project
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and …
Commentaries and Rejoinder on
While direct replications such as the “Many Labs” project are extremely valuable in testing the reliability of published findings across laboratories, they reflect the common reliance in psychology on single vignettes or stimuli, which limits the scope of the conclusions that can be reached. New experimental tools and statistical techniques make it easier to routinely sample stimuli, and to appropriately treat them as random factors. We encourage…
Using Mechanical Turk to Study Clinical Populations
Although participants with psychiatric symptoms, specific risk factors, or rare demographic characteristics can be difficult to identify and recruit for participation in research, participants with these characteristics are crucial for research in the social, behavioral, and clinical sciences. Online research in general and crowdsourcing software in particular may offer a solution. However, no research to date has examined the utility of crowdsou…
Warmer Hearts, Warmer Rooms: How Positive Communal Traits Increase Estimates of Ambient Temperature
Conceptual representations of warmth have been shown to be related to people's perceptions of ambient temperature. Based on this premise, we hypothesized that merely thinking about personality traits related to communion (but not agency) influences physical experience of warmth. Specifically, the three studies revealed that (a) perceptions of temperature are influenced by both positive and negative attributes within the communion but not agency d…
Running experiments on Amazon Mechanical Turk
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comp…
How extending your middle finger affects your perception of others: Learned movements influence concept accessibility
Investigating Variation in Replicability: A “Many Labs” Replication Project
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and …
How extending your middle finger affects your perception of others: Learned movements influence concept accessibility
Commentaries and Rejoinder on
While direct replications such as the “Many Labs” project are extremely valuable in testing the reliability of published findings across laboratories, they reflect the common reliance in psychology on single vignettes or stimuli, which limits the scope of the conclusions that can be reached. New experimental tools and statistical techniques make it easier to routinely sample stimuli, and to appropriately treat them as random factors. We encourage…
Likeableness and meaningfulness ratings of 555 (+487) person-descriptive words
Warmer Hearts, Warmer Rooms: How Positive Communal Traits Increase Estimates of Ambient Temperature
Conceptual representations of warmth have been shown to be related to people's perceptions of ambient temperature. Based on this premise, we hypothesized that merely thinking about personality traits related to communion (but not agency) influences physical experience of warmth. Specifically, the three studies revealed that (a) perceptions of temperature are influenced by both positive and negative attributes within the communion but not agency d…
How extending your middle finger affects your perception of others: Learned movements influence concept accessibility
Running experiments on Amazon Mechanical Turk
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comp…
Using Mechanical Turk to Study Clinical Populations
Although participants with psychiatric symptoms, specific risk factors, or rare demographic characteristics can be difficult to identify and recruit for participation in research, participants with these characteristics are crucial for research in the social, behavioral, and clinical sciences. Online research in general and crowdsourcing software in particular may offer a solution. However, no research to date has examined the utility of crowdsou…
Warmer Hearts, Warmer Rooms: How Positive Communal Traits Increase Estimates of Ambient Temperature
Conceptual representations of warmth have been shown to be related to people's perceptions of ambient temperature. Based on this premise, we hypothesized that merely thinking about personality traits related to communion (but not agency) influences physical experience of warmth. Specifically, the three studies revealed that (a) perceptions of temperature are influenced by both positive and negative attributes within the communion but not agency d…
Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Mechanical Turk (MTurk), an online labor market created by Amazon, has recently become popular among social scientists as a source of survey and experimental data. The workers who populate this market have been assessed on dimensions that are universally relevant to understanding whether, why, and when they should be recruited as research participants. We discuss the characteristics of MTurk as a participant pool for psychology and other social s…
Investigating Variation in Replicability: A “Many Labs” Replication Project
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and …
Commentaries and Rejoinder on
While direct replications such as the “Many Labs” project are extremely valuable in testing the reliability of published findings across laboratories, they reflect the common reliance in psychology on single vignettes or stimuli, which limits the scope of the conclusions that can be reached. New experimental tools and statistical techniques make it easier to routinely sample stimuli, and to appropriately treat them as random factors. We encourage…
The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate i…
Using Nonnaive Participants Can Reduce Effect Sizes
Although researchers often assume their participants are naive to experimental materials, this is not always the case. We investigated how prior exposure to a task affects subsequent experimental results. Participants in this study completed the same set of 12 experimental tasks at two points in time, first as a part of the Many Labs replication project and again a few days, a week, or a month later. Effect sizes were markedly lower in the second…
Conducting Clinical Research Using Crowdsourced Convenience Samples
Crowdsourcing has had a dramatic impact on the speed and scale at which scientific research can be conducted. Clinical scientists have particularly benefited from readily available research study participants and streamlined recruiting and payment systems afforded by Amazon Mechanical Turk (MTurk), a popular labor market for crowdsourcing workers. MTurk has been used in this capacity for more than five years. The popularity and novelty of the pla…
Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection
The online labor market Amazon Mechanical Turk (MTurk) is an increasingly popular source of respondents for social science research. A growing body of research has examined the demographic composition of MTurk workers as compared with that of other populations. While these comparisons have revealed the ways in which MTurk workers are and are not representative of the general population, variations among samples drawn from MTurk have received less…
Likeableness and meaningfulness ratings of 555 (+487) person-descriptive words
Online panels in social science research: Expanding sampling methods beyond Mechanical Turk
Amazon Mechanical Turk (MTurk) is widely used by behavioral scientists to recruit research participants. MTurk offers advantages over traditional student subject pools, but it also has important limitations. In particular, the MTurk population is small and potentially overused, and some groups of interest to behavioral scientists are underrepresented and difficult to recruit. Here we examined whether online research panels can avoid these limitat…
Psychology (12 works) · Mobile Crowdsensing and Crowdsourcing (8 works) · Social Psychology (8 works) · Computer Science (7 works) · Amazon rainforest (6 works) · Applied Psychology (6 works) · Data science (6 works) · Statistics (6 works) · Mathematics (5 works) · Sociology (5 works)