Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Field Experiments in Organizations

Bibliographic Data

ID15735544
AuthorsDov Eden (Tel Aviv University, corresponding author)
Year2017
Volume4
Issue1
Pages91-122
Publication date2017-01-09
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueAnnual Review of Organizational Psychology and Organizational Behavior (JOURNAL)
Journal identifiersISSN: 2327-0608 • E-ISSN: 2327-0616
PublisherAnnual Reviews (PUBLISHER • US)
DOI10.1146/annurev-orgpsych-041015-062400
OpenAlexW2571098051
LanguageEN
Citations received41
References cited197

Field experimentation, although rare, is the sterling-gold standard of organizational research methods. It yields the best internally valid and generalizable findings compared to more fallible methods. Reviewers in many psychology specialties, including organizational psychology, synthesize largely nonexperimental research, warn of causal ambiguity, and call for experimental replication. These calls go mostly unheeded. Practical application is a raison d'être for much organizational research. With the emergence of evidence-based management, field experiments enable us to deliver the most actionable tools to practitioners. This review explicates the role of experimental control and randomization and enumerates some of the factors that mitigate field experimentation. It describes, instantiates, and evaluates true field experiments, quasi-experiments, quasi-fields, combo designs, and triangulation. It also provides practical tips for overcoming deterrents to field experimentation. The review ends describing the merging of new technologies with classical experimental design and prophesying the bright future of organizational field experimentation

Ambiguity · Data science · Field (mathematics · Field research · Knowledge management · Management science · Organizational Behavior · Replication (statistics · Social science · Sociology · Computer Science · Engineering · Innovation and Knowledge Management · Management and Organizational Studies · Mathematics · Psychology · Social Psychology · Team Dynamics and Performance

  • Shadows of Integrity in Public Administration

    Open Access•Luis Garrido-Vergara•Shadows of Integrity in Public…•2026

  • Supporting interdependent telework employees

    SinHui Chong, Yi Huang et al.•Journal of Applied Psychology•2020

  • On doing relevant and rigorous experiments

    Open Access•Sirio Lonati, Bernardo F Quiroga et al.•Journal of Operations Management•2018

  • Beyond the ritualized use of questionnaires

    Open Access•Thomas Fischer, Donald C Hambrick et al.•The Leadership Quarterly•2020

  • Co-producing field experiments in public management research

    Ulrich Thy Jensen, Ole Helby Petersen et al.•Public Management Review•2024

  • Thriving on Strengths

    Open Access•Valesca Y Tobias, Marianne Van Woerkom et al.•Journal of Happiness Studies•2023

  • Country differences in the relationship between leadership and employee engagement

    Open Access•Peikai Li, Jian-Min Sun et al.•The Leadership Quarterly•2021

  • The effects of the charisma signal and voice pitch in female leader selection

    Open Access•Rafael Wilms, Janneke K Oostrom et al.•The Leadership Quarterly•2025

  • Leader development across the lifespan

    Open Access•Zhengguang Liu, Shruthi Venkatesh et al.•The Leadership Quarterly•2021

  • Estimating the causal effect of measured endogenous variables

    Open Access•Gwendolin B Sajons•The Leadership Quarterly•2020

  • The science of leadership

    Open Access•Dov Eden•The Leadership Quarterly•2021

  • Virtual charismatic leadership and signaling theory

    Open Access•Brittany A Ernst, George C Banks et al.•The Leadership Quarterly•2022

  • Leadership shaping social comparison to improve performance

    Open Access•Erik Waltré, Bart Dietz et al.•The Leadership Quarterly•2023

  • Measuring behaviors counterfactually

    Open Access•Thomas Fischer•The Leadership Quarterly•2023

  • Explaining the relational mechanisms and outcomes of multi‐modal leader–member‐exchange differentiation

    Open Access•Patrick F Bruning, Bradley J Alge et al.•Canadian Journal of Administrative…•2022

  • An Enumerative Review and a Meta‐Analysis of Primed Goal Effects on Organizational Behavior

    Open Access•Xiao Chen, Gary P Latham et al.•Applied Psychology•2021

  • Fostering science interests through head‐mounted displays

    Open Access•Martin Stolpe Andersen, Sara Klingenberg et al.•Journal of Computer Assisted…•2023

  • Methodological challenges and insights for future international business research

    Open Access•Herman Aguinis, Donald Bergh et al.•Journal of International Business…•2023

  • A Quasi-Experimental Exploration of Activity-Based Flexible Office Design and Demographic Differences in Employee Absenteeism

    Open Access•Ann Lauterbach, Florian Kunze•Environment and Behavior•2023

  • Changing the “Meaning of Place” Within a Hospital

    Open Access•Fabrizio Scrima, Marcello Nonnis et al.•Environment and Behavior•2023

  • Gender bias in funding evaluation

    Open Access•Laura Cruz Castro, Luis Sanz Menéndez•Quantitative Science Studies•2023

  • Tinkering With the Plumbing of Sustainable Enterprises

    Open Access•Andrew Spicer, Marcus Wagner et al.•Organization & Environment•2021

  • A Data Analysis Method for Using Longitudinal Binary Outcome Data from a SMART to Compare Adaptive Interventions

    John J Dziak, Jamie Yap et al.•Multivariate Behavioral Research•2019

  • Power and Sample Size Determination for Multilevel Mediation in Three-Level Cluster-Randomized Trials

    Ben Kelcey, Yanli Xie et al.•Multivariate Behavioral Research•2021

  • SMART Binary

    John J Dziak, Daniel Almirall et al.•Multivariate Behavioral Research•2024

  • Perspectives of a Practitioner-Scientist on Organizational Psychology/Organizational Behavior

    Gary P Latham•Annual Review of Organizational…•2018

  • A review of experimental research on organizational trust

    Open Access•Oliver Schilke, Andy Powell et al.•Journal of Trust Research•2023

  • Felt trust

    Open Access•Bart De Jong, Allan Lee et al.•Journal of Organizational Behavior•2024

  • Thought experiments

    Open Access•Herman Aguinis, Jose R Beltran et al.•Journal of Organizational Behavior•2022

  • Interplay between benefit appeal and valence framing in reducing smoking behavior

    Open Access•Nurit Nobel•Journal of Behavioral Decision…•2022

  • Understanding why employers discriminate, where and against whom

    Open Access•Di Stasio, Valentina Di Stasio et al.•Research in Social Stratification…•2019

  • Sowing the seeds of love

    Open Access•G Itzchakov, Sigal G Barsade et al.•Applied Psychology•2024

  • CO‐Design ‐ing a more context‐based , pluralistic, and participatory future for public administration

    Open Access•Kayla Schwoerer, Florian Keppeler et al.•Public Administration•2022

  • A Systematic Review of Field Experiments in Public Administration

    Open Access•Jesper Asring Hansen, Jesper Asring Jessen Hansen et al.•Public Administration Review•2020

  • Nudging healthier food choices in a cafeteria setting

    Open Access•Jan M Bauer, Sabine Bietz et al.•Appetite•2021

  • Exploring collaborative decision-making

    Open Access•Xinyue Hao, Emrah Demir et al.•Technology in Society•2024

  • How and when do work stressors and peer norms impact career entrants’ alcohol-related behavior and its consequences

    Open Access•Inbal Nahum‐Shani, Jamie RT Yap et al.•Human Relations•2025

  • The dark side of illegitimate tasks

    Open Access•Rahman Khan, Ghulam Murtaza et al.•Human Relations•2026

  • Behavioral Validity in Factorial Survey Experiments

    Open Access•Cecilie Krogh•CAM•2025

  • Thinking about Thinking

    James S Bowman•Public Integrity•2018

  • Marching to Her Own Beat

    Open Access•Aruna Ranganathan, Aayan Das•American Sociological Review•2023

  • Research Findings Practitioners Resist

    Tamara L Giluk, Tamara Giluk et al.•The Oxford handbook of…•2012

  • Field Experiments

    Open Access•Ruth K Ditlmann, Ruth Ditlmann et al.•International Encyclopedia of the…•2015

  • Handbook of Social Psychology

    Daniel Todd Gilbert, Gardner Lindzey et al.•Handbook of Social Psychology•2012

  • Psychology and industrial efficiency.

    Hugo Munsterberg•1913

  • Big Data, Little Data, No Data

    Christine L Borgman•Big Data, Little Data, No Data•2015

  • The Demography of Corporations and Industries

    Glenn R Carroll, Michael T Hannan•Demography of Corporations and…•2000

  • Designing Experiments That Generalize

    Open Access•Scott Highhouse•Organizational Research Methods•2009

  • Pygmalion, Galatea, and the Golem

    Elisha Babad, Elisha Y Babad et al.•Journal of Educational Psychology•1982

  • Field Experiments

    Glenn W Harrison, John A List•Journal of Economic Literature•2004

  • Moderating effects of initial leader–member exchange status on the effects of a leadership intervention.

    Terri A Scandura, George B Graen•Journal of Applied Psychology•1984

  • Temporal Distance and Discrimination

    Open Access•Katherine L Milkman, Modupe Akinola et al.•Psychological Science•2012

  • Research Methodology in Management

    Terri A Scandura, E A Williams•Academy of Management Journal•2000

  • Hostile and benevolent reactions toward pregnant women

    Michelle R Hebl, Edward B King et al.•Journal of Applied Psychology•2007

  • Developing and investigating the use of single-item measures in organizational research.

    Gwenith G Fisher, Russell A Matthews et al.•Journal of Occupational Health…•2016

  • Student‐recruited samples in organizational research

    Open Access•Anthony R Wheeler, Kristen K Shanine et al.•Journal of Occupational and…•2014

  • Getting even or moving on? Power, procedural justice, and types of offense as predictors of revenge, forgiveness, reconciliation, and avoidance in organizations.

    Karl Aquino, Thomas M Tripp et al.•Journal of Applied Psychology•2006

  • The Hawthorne effect

    John G Adair•Journal of Applied Psychology•1984

  • Job seeking, reemployment, and mental health

    Robert D Caplan, Amiram D Vinokur et al.•Journal of Applied Psychology•1989

  • Methods of Ecological Momentary Assessment in Organizational Research

    Open Access•Daniel J Beal, Howard M Weiss•Organizational Research Methods•2003

  • Collective efficacy, group potency, and group performance

    Alexander D Stajkovic, Dongseop Lee et al.•Journal of Applied Psychology•2009

  • Stealing in the Name of Justice

    Open Access•Jerald Greenberg•Organizational Behavior and Human…•1993

  • Impact of Transformational Leadership on Follower Development and Performance

    Tom Dvir, Dov Eden et al.•Academy of Management Journal•2002

  • JsPsych

    Open Access•Joshua R De Leeuw•Behavior Research Methods•2015

  • Can Charisma Be Taught? Tests of Two Interventions

    John Antonakis, Marika Fenley et al.•Academy of Management Learning &…•2011

  • The effects of organizational citizenship behavior on performance judgments

    Tammy D Allen, Michael C Rush•Journal of Applied Psychology•1998

  • A Critical Review and Best‐Practice Recommendations for Control Variable Usage

    Open Access•Jeremy B Bernerth, Herman Aguinis•Personnel Psychology•2016

  • Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments

    William R Shadish, M H Clark et al.•Journal of the American…•2008

  • An Inconvenient Truth

    Open Access•Richard N Landers, Tara S Behrend•Industrial and Organizational…•2015

  • The significance of task significance

    Adam M Grant•Journal of Applied Psychology•2008

  • Field experiments in economics

    Open Access•Steven D Levitt, John A List•European Economic Review•2009

  • Unethical for the sake of the group

    Stefan Thau, Rellie Derfler‐Rozin et al.•Journal of Applied Psychology•2015

  • Self-Efficacy

    Albert Bandura, W H Freeman et al.•Journal of Cognitive Psychotherapy•1999

  • The central role of the propensity score in observational studies for causal effects

    Paul R Rosenbaum, Donald B Rubin•Biometrika•1983

  • Estimating causal effects of treatments in randomized and nonrandomized studies.

    Donald B Rubin•Journal of Educational Psychology•1974

  • Amazon's Mechanical Turk

    Open Access•Michael D Buhrmester, Michael Buhrmester et al.•Perspectives on Psychological…•2011

  • Obtaining a Driver's License in India

    M Bertrand, Simeon Djankov et al.•The Quarterly Journal of Economics•2007

  • Research in the Psychological Laboratory

    Open Access•C Arnold Anderson, James J Lindsay et al.•Current Directions in Psychological…•1999

  • An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies

    Peter C Austin•Multivariate Behavioral Research•2011

  • The effects of feedback interventions on performance

    Avraham N Kluger, Angelo S Denisi et al.•Psychological Bulletin•1996

  • To prosper, organizational psychology should … overcome methodological barriers to progress

    Open Access•Jeffrey R Edwards•Journal of Organizational Behavior•2008

  • An Ounce of Prevention Is Worth a Pound of Cure

    Herman Aguinis, Robert J Vandenberg•Annual Review of Organizational…•2013

  • Organizational Psychology Then and Now

    Edgar H Schein•Annual Review of Organizational…•2015

  • What Was, What Is, and What May Be in OP/OB

    Lyman W Porter, Benjamin Schneider•Annual Review of Organizational…•2014

  • Evidence-Based Management

    Open Access•Sara L Rynes, Jean M Bartunek•Annual Review of Organizational…•2017

  • A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation

    Edward L Deci, Richard Koestner et al.•Psychological Bulletin•1999

  • Mixed Methods and Wicked Problems

    Open Access•Donna M Mertens•Journal of Mixed Methods Research•2014

  • Credible Causal Inference for Empirical Legal Studies

    Open Access•Daniel E Ho, Donald B Rubin•Annual Review of Law and Social…•2011

  • Assisting Unemployed Older Workers to Become Reemployed

    Open Access•John C Rife, John R Belcher•Research on Social Work Practice•1994

  • Pre-training perceived social self-efficacy accentuates the effects of a cross-cultural coping orientation program

    Open Access•Jinyan Fan, Lei Lai•Journal of Organizational Behavior•2014

  • Statistical control in correlational studies

    Open Access•Thomas E Becker, Guclu Atinc et al.•Journal of Organizational Behavior•2015

  • True Overconfidence in Interval Estimates

    Open Access•Markus Glaser, Thomas Langer et al.•Journal of Behavioral Decision…•2012

  • Effects of Monitoring on Mortgage Delinquency

    Open Access•Stephanie Moulton, June Mccormick Collins et al.•Journal of Policy Analysis and…•2014

  • Time preference before and after a risky activity – A field experiment

    Open Access•Tal Shavit, Mosi Rosenboim et al.•Journal of Economic Psychology•2014

  • Overconfidence, omens and gender heterogeneity

    Open Access•Maria De Paola, Francesca Gioia et al.•Journal of Economic Psychology•2014

  • Impact of the Jobs intervention on unemployed workers varying in risk for depression

    Open Access•Amiram D Vinokur, Richard H Price et al.•American Journal of Community…•1995

  • When controversial leaders with charisma are effective

    Open Access•Ernestine Gordijn, Ernestine H Gordijn et al.•European Journal of Social…•2008

  • The effect of implementation intentions on transfer of training

    Open Access•Shlomit Friedman, Simcha Ronen•European Journal of Social…•2015

  • An Experimental Approach to the Study of Autocracy and Democracy

    Kurt Lewin, Ronald Lippitt•Sociometry•1938

  • Performance‐Related Pay and the Crowding Out of Motivation in the Public Sector

    Open Access•Nicky Belle, Nicola Belle•Public Administration Review•2015

  • From field experiments to program implementation

    Open Access•Amiram D Vinokur, Richard H Price et al.•American Journal of Community…•1991

  • An Experiment on Participation in a Norwegian Factory

    Open Access•John R P French, Joachim Israel et al.•Human Relations•1960

  • Overcoming Resistance to Change

    Open Access•Lester Coch, John R P French•Human Relations•1948

  • The Use of Field Experiments for Studies of Employment Discrimination

    Open Access•Devah Pager•The Annals of the American…•2007

  • Temporal Adjustments in the Evaluation of Events

    Open Access•Terence R Mitchell, Leigh Thompson et al.•Journal of Experimental Social…•1997

  • The experimental change of a major organizational variable

    Nancy C Morse, Everett Reimer•Journal of Abnormal & Social…•1956

  • Patterns of Aggressive Behavior in Experimentally Created “Social Climates

    Kurt Lewin, Ronald Lippitt et al.•The Journal of Social Psychology•1939

  • Procedural justice and participation in task selection

    P Christopher Earley, A Lind et al.•Journal of Personality and Social…•1987

  • Compliance with rules

    John Thibaut, Nehemia Friedland et al.•Journal of Personality and Social…•1974

  • Methods of Organizational Research

    Stanley E Seashore, Victor Vroom et al.•American Sociological Review•1968

  • Statistical significance in psychological research

    David T Lykken•Psychological Bulletin•1968

  • Self-efficacy and work-related performance

    Alexander D Stajkovic, Fred Luthans•Psychological Bulletin•1998

  • The file drawer problem and tolerance for null results

    Robert Rosenthal•Psychological Bulletin•1979

  • Field Experiments with Firms

    Open Access•Oriana Bandiera, Iwan Barankay et al.•The Journal of Economic…•2011

  • Late Modernity and the Dynamics of Quasification

    Open Access•Alan Beardsworth, Alan Bryman•The Sociological Review•1999

  • The Natural Controlled Experiment in Organizational Research

    Paul S Goodman•Human Organization•1970

  • New Approaches to Understanding Racial Prejudice and Discrimination

    L Quillian•Annual Review of Sociology•2006

Unique citing works41
Citations per year5,13
Citation span2018 - 2026 (9)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 41

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae