Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Randomization Inference with Stata

A Guide and Software

Bibliographic Data

ID23329970
AuthorsSimon Heß (0000-0003-1776-0930, Goethe University Frankfurt, corresponding author)
Year2017
Volume17
Issue3
Pages630-651
Publication date2017-09-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueThe Stata Journal: Promoting communications on statistics and Stata (JOURNAL)
Journal identifiersISSN: 1536-867X • E-ISSN: 1536-8734
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/1536867x1701700306
OpenAlexW2768098152
LanguageEN
Citations received68
References cited19

Randomization inference or permutation tests are only sporadically used in economics and other social sciences—this despite a steep increase in randomization in field and laboratory experiments that provide perfect experimental setups for applying randomization inference. In the context of causal inference, such tests can handle problems often faced by applied researchers, including issues arising in the context of small samples, stratified or clustered treatment assignments, or nonstandard randomization techniques. Standard statistical software packages have either no implementation of randomization tests or very basic implementations. Whenever researchers use randomization inference, they regularly code individual program routines, risking inconsistencies and coding mistakes. In this article, I show how randomization inference can best be conducted in Stata and introduce a new command, ritest, to simplify such analyses. I illustrate this approach's usefulness by replicating the results in Fujiwara and Wantchekon (2013, American Economic Journal: Applied Economics 5: 241–255) and running simulations. The applications cover clustered and stratified assignments, with varying cluster sizes, pairwise randomization, and the computation of nonapproximate p-values. The applications also touch upon joint hypothesis testing with randomization inference.

Algorithm · Context (archaeology) · Data mining · Econometrics · Inference · Machine learning · Pairwise comparison · Permutation (music) · Randomization · Randomized controlled trial · Resampling · Restricted randomization · Statistics · Advanced Causal Inference Techniques · Artificial Intelligence · Computer Science · Mathematics · Media Influence and Politics · Statistical Methods and Inference · Theoretical Computer Science

  • To shop or shelter? Issue framing effects and social-distancing preferences in the Covid-19 pandemic

    Open Access•Aaron Deslatte•Journal of Behavioral Public…•2020

  • Health Care Following Environmental Disasters

    Open Access•Shooshan Danagoulian, Daniel Grossman et al.•Journal of Policy Analysis and…•2022

  • Does Diversity Matter for Health? Experimental Evidence from Oakland

    Marcella Alsan, Owen Garrick et al.•American Economic Review•2019

  • How do protests affect electoral choices? Evidence from Egypt

    Open Access•Nelly Elmallakh•Journal of Economic Behavior &…•2020

  • The effect of acute tryptophan depletion on beliefs in a Stag Hunt game

    Open Access•Paul Bengart, Carolyn H Declerck et al.•Journal of Economic Behavior &…•2025

  • The Effect of Student–Advisor Match on Retention and Performance

    Open Access•Alexei Karas•Research in Higher Education•2026

  • Virtual Instruction Effects Within University Courses

    Open Access•Manuel Flores, Mariana Gerstenblüth et al.•Research in Higher Education•2025

  • A representative-represented matrix

    Sanghee Park•Public Management Review•2024

  • Demand for environmental quality

    Open Access•Charles Yaw Okyere•Water Policy•2021

  • The Cross-Border Spillover Effects of Cannabis Regulation in South America

    Open Access•Bruno de Assis, Giovanni di Pietra et al.•Journal of Quantitative Criminology•2025

  • Educational impacts of an unconditional cash transfer program in Mali

    Open Access•Fidele Eric Sessou, Melissa Hidrobo et al.•Economics of Education Review•2024

  • Investment in identity in the field-Nudging refugees’ integration effort

    Open Access•Nora Grote, Tim Klausmann et al.•European Journal of Political…•2023

  • Administrative areas and regional identity formation

    Open Access•Stefanie Gäbler, Kim Leonie Kellermann•Regional Science and Urban…•2025

  • Does Knowing Other Workers’ Wage Level Promote Employees’ Pay Fairness Perception? Evidence From a Randomized Survey Experiment

    Open Access•Kwang Bin Bae, Hosung Sohn et al.•Public Personnel Management•2022

  • Political selection when uncertainty is high

    Open Access•Thushyanthan Baskaran, Zohal Hessami et al.•Kyklos•2023

  • Public sector culture does not increase honest behavior

    Open Access•Raanan Sulitzeanu-Kenan, Melissa Tepe et al.•Behavioural Public Policy•2026

  • Does Deliberative Education Increase Civic Competence? Results from a Field Experiment

    Open Access•Mikael Persson, Klas Andersson et al.•Journal of Experimental Political…•2019

  • Consumption and borrowing

    Open Access•Abhishek Shaw, Sawan Rathi et al.•The Journal of Economic Inequality•2025

  • Attempting to reduce traffic stop racial disparities

    Open Access•Travis M Carter, Scott E Wolfe et al.•Criminology & Public Policy•2024

  • Mitigating the Turnout Effects of Bad Weather With Early Voting

    Open Access•Martin Johnson, Robert M Stein•American Politics Research•2022

  • Do State Legislative Staffer Networks Influence Roll-call Voting? Evidence from Shared Personal Staffers in Arizona, Indiana, and New Mexico

    Open Access•Michelangelo Landgrave•State Politics & Policy Quarterly•2024

  • Does Procedural Fairness Impact Public Perception of Judicial Opinions? Evidence from a Survey Experiment

    Open Access•Rob Robinson, Danieli Evans•Law & Social Inquiry•2025

  • Lead-farmer extension and smallholder valuation of new agricultural technologies in Tanzania

    Open Access•Stephen Morgan, Stephen N Morgan et al.•Food Policy•2020

  • Impact of agricultural extension services on the adoption of improved wheat variety in Ethiopia

    Open Access•Asresu Yitayew, Awudu Abdulai et al.•World Development•2021

  • Voluntary audits

    Open Access•Ana L De La O, Lucas I González et al.•World Development•2022

  • Does representation affect trust in political institutions

    Open Access•Rolly Kukreja•World Development•2024

  • Can technology improve the classroom experience in primary education? An African experiment on a worldwide program

    Open Access•Joana Cardim, Teresa Molina-Millán et al.•Journal of Development Economics•2023

  • Performance bonuses in the public sector

    Open Access•Prakarsh Singh, William A Masters•Journal of Development Economics•2018

  • Environmental effects of development programs

    Open Access•Simon Heß, Dany Jaimovich et al.•Journal of Development Economics•2021

  • The fruits (and vegetables) of crime

    Open Access•Julian Dyer•Journal of Development Economics•2023

  • Better together? Group incentives and the demand for prevention

    Open Access•Mylene Lagarde, Carlos Riumallo-Herl•Journal of Development Economics•2024

  • Relief from usury

    Open Access•Vivian Hoffmann, Vyjayanthi Rao et al.•Journal of Development Economics•2020

  • How do political connections of firms matter during an economic crisis

    Open Access•Yutong Chen, Gaurav Chiplunkar et al.•Journal of Development Economics•2025

  • Flexible contracting and quality upgrading under market volatility

    Open Access•Joshua Deutschmann, Tanguy Bernard et al.•Journal of Development Economics•2026

  • Healthcare at the beginning of life and child survival

    Open Access•Edward N Okeke, Isa S Abubakar•Journal of Development Economics•2019

  • Body and mind

    Open Access•Patrick Lubega, Frances Nakakawa et al.•Journal of Development Economics•2021

  • Quality signaling and demand for renewable energy technology

    Open Access•Aidan Coville, Joshua Graff Zivin et al.•Journal of Development Economics•2025

  • Storm autocracies”

    Open Access•Muhammad Habibur Rahman, Nejat Anbarci et al.•Journal of Development Economics•2022

  • Chat over coffee? Diffusion of agronomic practices and market spillovers in Rwanda

    Open Access•Esther Duflo, Daniel Keniston et al.•Journal of Development Economics•2026

  • College opportunity and teen fertility

    Open Access•Michael D Bloem, Jesús Villero•Journal of Development Economics•2024

  • Protecting infants from natural disasters

    Open Access•Snaebjorn Gunnsteinsson, Teresa Molina et al.•Journal of Development Economics•2022

  • Contract farming and rural transformation

    Open Access•Aminou Arouna, Jeffrey D Michler et al.•Journal of Development Economics•2021

  • Increasing women’s empowerment

    Open Access•Kate Ambler, Kelly Jones et al.•Journal of Development Economics•2025

  • Reducing Alcohol‐Related Violence with Bartenders

    Open Access•Andrés Ham, Diego Maldonado et al.•Journal of Policy Analysis and…•2021

  • The effect of the WHO Safe Childbirth Checklist on essential delivery practices and birth outcomes

    Open Access•Jana Kuhnt, Ashfa Hashmi et al.•SSM - Population Health•2023

  • Decision Biases and Heuristics Among Emergency Managers

    Open Access•Patrick S Roberts, Kris Wernstedt•The American Review of Public…•2018

  • Economic crimes and trust toward political institutions

    Open Access•Flaviana Palmisano•Journal of Economic Psychology•2025

  • Delegation and resistance

    Open Access•Touria Jaaidane, Sophie Larribeau•Cliometrica•2026

  • Making the Grade

    Jason T Kerwin, Rebecca Thornton et al.•The Review of Economics and…•2021

  • Religious Divisions and Production Technology

    Arkadev Ghosh•Journal of Political Economy•2025

  • Can Redistribution Change Policy Views? Aid and Attitudes toward Refugees

    Travis Baseler, Thomas C Ginn et al.•Journal of Political Economy•2025

  • Low-Cost Low-Touch Information Provision, Parental Involvement, and Student Learning Outcomes

    Asep Kurniawan, Sandy Maulana et al.•The Journal of Development Studies•2026

  • Experimenting with a green ‘Green Revolution’. Evidence from a randomised controlled trial in Indonesia

    Open Access•Michael Grimm, Nathalie Luck•Ecological Economics•2023

  • Lady Justice

    Open Access•Alessandra Foresta•European Journal of Political…•2025

  • Economic risk perceptions and willingness to learn about globalization

    Open Access•Niccolò W Bonifai, Edmund J Malesky et al.•American Journal of Political…•2025

  • How price-gouging regulation undermined Covid-19 mitigation

    Open Access•Rik Chakraborti, Gavin Roberts•Public Choice•2023

  • Malleability of Preferences for Honesty

    Open Access•Johannes Abeler, Aliya Falk et al.•The Economic Journal•2025

  • The mark or trace of a criminal record

    Open Access•Sarah Lageson, R Apel•Criminology•2025

  • Restorative for All? Racial Disproportionality and School Discipline Under Restorative Justice

    Open Access•Miles Davison, Andrew M Penner et al.•American Educational Research…•2022

  • Accelerating Opportunity

    Open Access•Thomas S Dee, Elizabeth Huffaker•American Educational Research…•2026

  • The Hostile Mediator Phenomenon

    Open Access•Omer Yair•Public Opinion Quarterly•2021

  • Positive Spillovers from Negative Campaigning

    Open Access•Vincenzo Galasso, Tommaso Nannicini et al.•American Journal of Political…•2023

  • Intergenerational support during the rise of mobile telecommunication in Indonesia

    Open Access•Yiyue Huangfu, Jenna Nobles•Demographic Research•2022

  • Trade, Slavery, and State Coercion of Labor

    Open Access•Mohamed Saleh•The Journal of Economic History•2024

  • Does money strengthen our social ties? Longitudinal evidence of lottery winners

    Open Access•Joan Costa-Font, Nattavudh Powdthavee•Rationality and Society•2023

  • Can Bridging the Learning Gap Improve Test Scores On A Key National Exam? Evidence From A Remedial Education Program in Indian Secondary Schools

    Gaurav Chiplunkar, Diva Dhar et al.•Economic Development and Cultural…•2025

  • Labor Market Information and Parental Attitudes toward Women Working Outside the Home

    Momoe Makino•Economic Development and Cultural…•2024

  • Violence and Voting in the United States

    Open Access•Laura García-Montoya, Ángeles Arjona et al.•American Political Science Review•2022

  • Causal Inference for Statistics, Social, and Biomedical Sciences

    Guido W Imbens, Donald B Rubin•Causal Inference in Statistics,…•2015

  • Observational Studies

    Open Access•Paul R Rosenbaum•Observational Studies•2002

  • Design of Observational Studies

    Open Access•Paul R Rosenbaum•Design of Observational Studies•2010

  • Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing

    Joseph P Romano, Michael Wolf•Journal of the American…•2005

  • In Pursuit of Balance

    Miriam Bruhn, David Mckenzie•American Economic Journal Applied…•2009

  • Randomization Inference in the Regression Discontinuity Design

    Open Access•Matias D Cattaneo, Brigham R Frandsen et al.•Journal of Causal Inference•2015

  • Free Distribution or Cost-Sharing? Evidence from a Randomized Malaria Prevention Experiment

    Jessica Cohen, Pascaline Dupas•The Quarterly Journal of Economics•2010

  • Wild Bootstrap Inference for Wildly Different Cluster Sizes

    Open Access•James G MacKinnon, Matthew D Webb•Journal of Applied Econometrics•2017

  • Channeling Fisher

    Open Access•Alwyn Young•The Quarterly Journal of Economics•2019

  • A Practitioner’s Guide to Cluster-Robust Inference

    A Colin Cameron, Douglas L Miller•The Journal of Human Resources•2015

  • Handbook Of Development Economics

    T Paul Schultz•Handbook Of Development Economics•2008

  • Mostly Harmless Econometrics

    Joshua D Angrist, Jorn‐steffen Pischke et al.•Mostly Harmless Econometrics•2009

  • Comparing Inference Approaches for RD Designs

    Open Access•Matias D Cattaneo, Rocío Titiunik et al.•Journal of Policy Analysis and…•2017

  • Deterring or Displacing Electoral Irregularities? Spillover Effects of Observers in a Randomized Field Experiment in Ghana

    Nahomi Ichino, Matthias Schündeln•The Journal of Politics•2012

  • Tantalus on the Road to Asymptopia

    Open Access•Edward E Leamer•The Journal of Economic…•2010

Unique citing works68
Citations per year8,5
Citation span2018 - 2026 (9)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 66

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae