Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Ecometrics in the Age of Big Data

Measuring and Assessing “Broken Windows” Using Large-scale Administrative Records

Bibliographic Data

ID6169995
AuthorsDaniel Tumminelli O''Brien (0000-0002-3799-8586, Harvard University Press), Robert J Sampson (0000-0003-4259-8146, Harvard University, Cambridge, MA, USA), C Winship (0000-0002-0632-241X, Harvard University Press)
Year2015
Volume45
Issue1
Pages101-147
Publication date2015-04-16
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSociological Methodology (JOURNAL)
Journal identifiersISSN: 0081-1750 • E-ISSN: 1467-9531
PublisherSAGE Publishing (PUBLISHER • US)
DOI10.1177/0081175015576601
OpenAlexW2046957061
LanguageEN
Citations received59
References cited37

The collection of large-scale administrative records in electronic form by many cities provides a new opportunity for the measurement and longitudinal tracking of neighborhood characteristics, but one that will require novel methodologies that convert such data into research-relevant measures. The authors illustrate these challenges by developing measures of “broken windows” from Boston’s constituent relationship management (CRM) system (aka 311 hotline). A 16-month archive of the CRM database contains more than 300,000 address-based requests for city services, many of which reference physical incivilities (e.g., graffiti removal). The authors carry out three ecometric analyses, each building on the previous one. Analysis 1 examines the content of the measure, identifying 28 items that constitute two independent constructs, private neglect and public denigration. Analysis 2 assesses the validity of the measure by using investigator-initiated neighborhood audits to examine the “civic response rate” across neighborhoods. Indicators of civic response were then extracted from the CRM database so that measurement adjustments could be automated. These adjustments were calibrated against measures of litter from the objective audits. Analysis 3 examines the reliability of the composite measure of physical disorder at different spatiotemporal windows, finding that census tracts can be measured at two-month intervals and census block groups at six-month intervals. The final measures are highly detailed, can be tracked longitudinally, and are virtually costless. This framework thus provides an example of how new forms of large-scale administrative data can yield ecometric measurement for urban science while illustrating the methodological challenges that must be addressed

American Community Survey · Audit · Business · Cartography · Census · Cronbach's alpha · Data collection · Data science · Database · Geography · Measure (data warehouse · Psychometrics · Reliability (semiconductor · Scale (ratio · Sociology · Statistics · Accounting · Computer Science · Crime Patterns and Interventions · Mathematics · Urban Transport and Accessibility · Urban, Neighborhood, and Segregation Studies

  • The Other Side of the Broken Window

    Open Access•Daniel Tumminelli O''Brien, Barrett Montgomery et al.•American Journal of Community…•2015

  • Urban Data Science

    Open Access•Tina Law, Joscha Legewie•Emerging Trends in the Social and…•2018

  • How and Why is Crime More Concentrated in Some Neighborhoods than Others

    Open Access•Daniel Tumminelli O''Brien, Alexandra Ciomek et al.•Journal of Quantitative Criminology•2022

  • Policing Social Disorder and Broken Windows Theory

    Open Access•Enrique García-Tejeda, Gustavo Fondevila•ISPRS International Journal of…•2023

  • Eviction and the Dissolution of Neighborhoods

    Eric Joseph Van Holm, Jake Monaghan•Housing Policy Debate•2021

  • “Eyes” on the Street

    Open Access•Riley Tucker, A Chao et al.•Journal of Quantitative Criminology•2026

  • Who ‘Tweets’ Where and When, and How Does it Help Understand Crime Rates at Places? Measuring the Presence of Tourists and Commuters in Ambient Populations

    Open Access•Riley Tucker, Daniel Tumminelli O''Brien et al.•Journal of Quantitative Criminology•2021

  • The Emergence and Evolution of Problematic Properties

    Open Access•Daniel Tumminelli O''Brien, Alina Ristea et al.•Journal of Quantitative Criminology•2023

  • Heard Shots – Call the Police? An Examination of Citizen Responses To Gunfire

    Beth M Huebner, Theodore S Lentz et al.•Justice Quarterly•2022

  • The Effects of a Place-Based Intervention on Resident Reporting of Crime and Service Needs

    Open Access•Eleanor Dickens, Noah Greifer et al.•Justice Quarterly•2026

  • Rating places and crime prevention

    Open Access•Thom Snaphaan, Wim Hardyns et al.•Computers Environment and Urban…•2024

  • Utilizing geo-referenced imagery for systematic social observation of neighborhood disorder

    Open Access•Thom Snaphaan, Wim Hardyns•Computers Environment and Urban…•2021

  • Investigating the effect of people on the street and streetscape physical environment on the location choice of street theft crime offenders using street view images and a discrete spatial choice model

    Open Access•Han Yue, Lin Liu et al.•Applied Geography•2023

  • Graffiti and crime in Belo Horizonte, Brazil

    Open Access•Alexandre Magno Alves Diniz, Alexandre Magno Diniz et al.•Applied Geography•2021

  • Neighborhood Blighted Property Removal and 311 Calls for Non‐Emergency Services

    Open Access•Katherine P Theall, Christopher N Morrison et al.•Geographical Analysis•2022

  • A roundtable discussion

    Open Access•Organizers Organizers, Woosung Kang et al.•Environment and Planning B Urban…•2019

  • Noise and the city

    Open Access•Amanda Hong, Byoungjun Kim et al.•Environment and Planning B Urban…•2020

  • Perceived neighborhood disorder, racial-ethnic discrimination and leading risk factors for chronic disease among women

    Open Access•Jesse J Plascak, Bernadette C Hohl et al.•SSM - Population Health•2018

  • The Intersection of Neighborhood Environment and Adverse Childhood Experiences

    Open Access•Krista Schroeder, Levent Dumenci et al.•International Journal of…•2022

  • The Real Gold Standard

    Daniel S Nagin, Robert J Sampson•Annual Review of Criminology•2018

  • Broken Windows, Informal Social Control, and Crime

    Charles C Lanfear, Ross L Matsueda et al.•Annual Review of Criminology•2019

  • Strengthening Sociological Research through Public Records Requests

    Open Access•Pierce Greenberg•Social Currents•2015

  • The spatial diffusion of homicide in Mexico City

    Carlos J Vilalta Perdomo, Pablo López-Ramírez et al.•Global Crime•2021

  • Community and Urban Places in a Digital World

    Open Access•Robert Goodspeed•City and Community•2017

  • Development and validation of statewide survey-based measures of livability in Connecticut

    Open Access•Nishita Dsouza, Amy Carroll-Scott et al.•Health & Place•2024

  • Parking in inner versus outer city spaces

    Open Access•Siqin Wang, Yan Liu•Journal of Transport Geography•2021

  • Nonprobability Sampling and Twitter

    Open Access•Patrick Rafail•Social Science Computer Review•2017

  • Toward Equitable Micromobility

    Open Access•Shunhua Bai, Junfeng Jiao•Journal of Planning Education and…•2021

  • From shared micro-mobility to shared responsibility

    Shunhua Bai, Junfeng Jiao•Journal of Urban Affairs•2020

  • St. Louis’s “urban prairie”

    Christopher Prener, Taylor Harris Braswell et al.•Journal of Urban Affairs•2018

  • A socio-spatial analysis of neighbour complaints using large-scale administrative data

    Open Access•Yan Liu, Lynda Cheshire et al.•Cities•2019

  • Lamp Lighters and Sidewalk Smoothers

    Open Access•Daniel Tumminelli O''Brien, Daniel T O'Brien•American Journal of Community…•2016

  • Understanding Misdemeanor Enforcement

    Open Access•Emily Morgan Glazener, Meghan M Kozlowski et al.•Journal of Community Psychology•2020

  • Does carnival contribute to crime? Examining the spatiotemporal effects of Mardi Gras on New Orleans Crime Trends (2012–2024)

    Open Access•N Petersen, Patrick Rafail et al.•Journal of Criminal Justice•2026

  • Activity locations, residential segregation and the significance of residential neighbourhood boundary perceptions

    Open Access•Nicolo P Pinchak, C R Browning et al.•Urban Studies•2021

  • Neighbourhood effects and beyond

    Open Access•Robert J Sampson•Urban Studies•2019

  • Neighbourhood change and neighbour complaints

    Open Access•Lynda Cheshire, Robin Fitzgerald et al.•Urban Studies•2019

  • Not Even Our Own Facts

    Open Access•James P Lynch, James Lynch•Criminology•2018

  • Crime Sensing with Big Data

    Open Access•Matthew L Williams, Pete Burnap et al.•The British Journal of Criminology•2016

  • Crowdsourcing Subjective Perceptions of Neighbourhood Disorder

    Open Access•Reka Solymosi, Kate J Bowers et al.•The British Journal of Criminology•2018

  • Police Enforcement of Street Prostitution as a Quality-of-Life Offense

    Bernard C Cohen, Bernard Cohen•Deviant Behavior•2019

  • Call and Response? Neighborhood Inequality and Political Voice

    Open Access•Amber Wichowsky, Paru Shah et al.•Urban Affairs Review•2021

  • From complaints to insights

    Open Access•Madeleine Guyot, Iris Thomas et al.•Cities•2025

  • The Problems with Neighbors

    Open Access•Yan Liu, Siqin Wang et al.•Urban Affairs Review•2023

  • Neighborhood Distribution of Unsheltered Homelessness and its Temporal Changes

    Open Access•Eun Jin Shin•Urban Affairs Review•2023

  • The Promises and Pitfalls of 311 Data

    Open Access•Ariel White, Kris-Stella Trump•Urban Affairs Review•2018

  • Building Holistic Evidence for Social Media Impact

    Open Access•Ines Mergel•Public Administration Review•2017

  • Dog fouling and potholes

    Open Access•Peter Matthews, Alex Parsons et al.•Local Government Studies•2023

  • Gentrification, White Encroachment, and the Policing of Black Residents in Washington, DC

    Open Access•Tanya Golash-Boza, Hyunsu Oh et al.•Critical Criminology•2023

  • Researching Crime After a Disaster

    Open Access•Frederick D Weil•American Behavioral Scientist•2020

  • An On-the-Ground Challenge to Uses of Spatial Big Data in Assessing Neighborhood Character

    Open Access•Bloch•Geographical Review•2020

  • What are the threats and potentials of big data for qualitative research

    Open Access•Kathy A Mills•Qualitative Research•2018

  • Administrative mediation data as naturally-occurring records of disputes with neighbours and the unmaking of home

    Open Access•Lynda Cheshire, Charlotte Ten Have•Current Sociology•2020

  • Racialized Reshuffling

    Jackelyn Hwang, Tyler W Mcdaniel•Annual Review of Sociology•2022

  • Territoriality and the Emergence of Norms During the Covid-19 Pandemic

    Patrick Bergemann, Christof Brandtner•American Journal of Sociology•2025

  • Contested Boundaries

    Joscha Legewie, Merlin Schaeffer•American Journal of Sociology•2016

  • Physical disorder and crime revisited

    Open Access•Xiaojin Chen, Patrick Rafail•Social Science Research•2022

  • The role of administrative data in the big data revolution in social science research

    Open Access•Roxanne Connelly, Christopher J Playford et al.•Social Science Research•2016

  • Using small data to interpret big data

    Open Access•Daniel Tumminelli O''Brien•Social Science Research•2016

  • The Death and Life of Great American Cities

    Jane Jacobs•The Death and Life of Great…•1961

  • Great American City

    Robert J Sampson, William Julius Wilson•Great American City•2012

  • The Homevoter Hypothesis

    William A Fischel•Homevoter Hypothesis•2009

  • The Parable of Google Flu

    Open Access•David Lazer, Ryan Kennedy et al.•Science•2014

  • Relation between Neighborhood Environments and Obesity in the Multi-Ethnic Study of Atherosclerosis

    Mahasin S Mujahid, Ana V Diez Roux et al.•American Journal of Epidemiology•2008

  • Private traits and attributes are predictable from digital records of human behavior

    Open Access•Michal Kosinski, David Stillwell et al.•Proceedings of the National…•2013

  • Incivilities, place attachment and crime

    Open Access•B Bradford Brown, Douglas D Perkins et al.•Journal of Environmental Psychology•2004

  • Using Google Street View to Audit Neighborhood Environments

    Open Access•Andrew Rundle, Michael D M Bader et al.•American Journal of Preventive…•2011

  • Inferring friendship network structure by using mobile phone data

    Open Access•Nathan Eagle, Alex Pentland et al.•Proceedings of the National…•2009

  • Perceptions of disorder

    Open Access•Luisa Franzini, Margaret O''Brien Caughy et al.•Journal of Environmental Psychology•2008

  • Computational Social Science

    Open Access•David Lazer, Alex Pentland et al.•Science•2009

  • The Death and Life of Great American Cities

    Jane Jacobs•Readings in Planning Theory•2015

  • Disorder and Decay

    Open Access•C E Ro, CATHERINE E ROSS et al.•Urban Affairs Review•1999

  • Breaking Away from Broken Windows

    Robert B Taylor, Ralph B Taylor et al.•Breaking Away from Broken Windows•2018

  • Disorder and Decline

    Open Access•Wesley G Skogan, Wesley Skogan•Journal of Research in Crime and…•2015

  • A brief observational measure for urban neighborhoods

    Open Access•Margaret O''Brien Caughy, Patricia O’campo et al.•Health & Place•2001

  • Seeing Disorder

    Open Access•Robert J Sampson, Stephen W Raudenbush•Social Psychology Quarterly•2004

  • The Effect of Residential Neighborhood on Child Behavior Problems in First Grade

    Open Access•Margaret O''Brien Caughy, Margaret O'Brien Caughy et al.•American Journal of Community…•2008

  • Broken Windows and Low Adolescent Prosociality

    Open Access•Daniel Tumminelli O''Brien, Daniel Tumminelli O'Brien et al.•American Journal of Community…•2013

  • Community perception

    Daniel Tumminelli O''Brien, D S Wilson•Journal of Personality and Social…•2011

  • Voice and Equality

    Henry Brady, Sidney Verba et al.•Voice and Equality•1995

  • Ecometrics

    Open Access•Stephen W Raudenbush, Robert J Sampson•Sociological Methodology•1999

  • Making Democracy Work

    Robert D Putnam, Robert Leonardi et al.•Making Democracy Work•1994

  • Managing the Urban Commons

    Open Access•Daniel Tumminelli O''Brien, Daniel Tumminelli O’brien•Human Nature•2012

  • Divergent Pathways of Gentrification

    Open Access•Jackelyn Hwang, Robert J Sampson•American Sociological Review•2014

  • Objective and perceived neighborhood environment, individual SES and psychosocial factors, and self-rated health

    Open Access•Ming Wen, Louise C Hawkley et al.•Social Science & Medicine•2006

  • An examination of processes linking perceived neighborhood disorder and obesity

    Open Access•Amy M Burdette, T D Hill•Social Science & Medicine•2008

  • Powerlessness and the Amplification of Threat

    Catherine E Ro, CATHERINE E ROSS et al.•American Sociological Review•2001

  • Talk Is Cheap

    Open Access•Colin Jerolmack, Shamus Khan•Sociological Methods & Research•2014

  • Contested Boundaries

    Joscha Legewie, Merlin Schaeffer•American Journal of Sociology•2016

Unique citing works59
Citations per year5,36
Citation span2015 - 2026 (12)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 58

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae