Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Whom Do Bureaucrats Believe? A Randomized Controlled Experiment Testing Perceptions of Credibility of Policy Research

Bibliographic Data

ID6328119
AuthorsCarey Doberstein (0000-0001-5106-8484, corresponding author)
Year2017
Volume45
Issue2
Pages384-405
Publication date2017-05-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenuePolicy Studies Journal (JOURNAL)
Journal identifiersISSN: 0190-292X • E-ISSN: 1541-0072
PublisherWiley (PUBLISHER • GB)
DOI10.1111/psj.12166
OpenAlexW2413909210
LanguageEN
Citations received29
References cited51

More than ever before, analysts in government have access to policy‐relevant research and advocacy, which they consume and apply in their role in the policy process. Academics have historically occupied a privileged position of authority and legitimacy, but some argue this is changing with the rapid growth of think tanks and research‐based advocacy organizations. This article documents the findings from a randomized controlled survey experiment using policy analysts from the British Columbia provincial government in Canada to systematically test the source effects of policy research in two subject areas: minimum wage and income‐splitting tax policy. Subjects were asked to read research summaries of these topics and then assess the credibility of each article, but for half of the survey respondents the affiliation/authorship of the content was randomly reassigned. The experimental findings lend evidence to the hypothesis that academic research is perceived to be substantially more credible than think tank or advocacy organization research, regardless of its content. That increasingly externalized policy advice systems are not a pluralistic arena of policy research and advice, but instead subject to powerful heuristics that bureaucrats use to sift through policy‐relevant information and advice, demands added nuance to both location and content‐based policy advisory system models

Content analysis · Credibility · Economics · Government (linguistics · Heuristics · Legitimacy · Perception · Political science · Politics · Public economics · Public relations · Social science · Sociology · Subject (documents · Test (biology · Electoral Systems and Political Participation · Law · Policy Transfer and Learning · Psychology · Public Administration · Public Policy and Administration Research

  • Shadows of Integrity in Public Administration

    Open Access•Luis Garrido-Vergara•Shadows of Integrity in Public…•2026

  • Education faculty as knowledge brokers

    Open Access•Gary L Anderson, Nakia M Gray-Nicolas et al.•Education Policy Analysis Archives•2021

  • Enhancing Policy Capacity in South Korea

    Open Access•Kwangseon Hwang, Hyunseok Hwang•Cogent Social Sciences•2025

  • Advising under constraint

    Open Access•Fatima Abdul Ghaffar, Denise Tsang et al.•Cogent Social Sciences•2026

  • Advocacy, activism, and lobbying

    Open Access•Nasreen Jessani, Brenton Ling et al.•PLOS Global Public Health•2022

  • The effects of EU conditionality on patterns of policy engagement of civil society organizations in candidate countries

    Igor Vidačak•Journal of Southeast European and…•2021

  • Negativity trumps source

    Yuyan Cao, Xin Liang•Public Management Review•2026

  • Les portes tournantes entre les think tanks, l’administration publique et les partis politiques

    Stéphanie Yates, Alexandra Turgeon•Politique et Sociétés•2022

  • Grounding the political spectrum

    Julien Landry•Critical Policy Studies•2019

  • How perceptions of voter control affect politicians’ evaluations of expertise in the news

    Anina Hanimann•Evidence & Policy•2023

  • What do advocates want from policy research? Evidence from elite surveys

    Jake Haselswerdt, Elizabeth Rigby•Evidence & Policy•2020

  • Knowledge brokering organisations

    Open Access•Eleanor Mackillop, James Downe•Evidence & Policy•2022

  • Mind the Gap? Comparing De Facto and De Jure Expert Authority of International Public Administrations in Financial and Agricultural Policy

    Open Access•Per-Olof Busch, Mirko Heinzel et al.•Journal of Comparative Policy…•2020

  • Birds of a feather? The determinants of impartiality perceptions of the IMF and the World Bank

    Open Access•Mirko Heinzel, Jonas Richter et al.•Review of International Political…•2020

  • The Credibility Chasm in Policy Research from Academics, Think Tanks, and Advocacy Organizations

    Carey Doberstein•Canadian Public Policy•2017

  • The heart of bureaucratic power

    Open Access•Andrea Liese, Jana Herold et al.•Review of International Studies•2021

  • Ministerial advisers in executive government

    Open Access•Thurid Hustedt, Kristoffer Kolltveit et al.•Public Administration•2017

  • Bureaucratic biases in trust of expert policy advice

    Open Access•Jingjing Zeng, Guihua Huang•Policy Sciences•2024

  • Policy advice utilization in Belgian ministerial cabinets

    Open Access•Pierre Squevin, David Aubin•International Review of…•2023

  • An emerging experimental approach to public administration research in Canada

    Open Access•Carey Doberstein•Canadian Public Administration•2017

  • Understanding evidence and behavioral responses

    Open Access•Pierre‐olivier Bédard•Canadian Public Administration•2017

  • The knowledge behind Brexit. A bibliographic analysis of ex-ante policy appraisals on Brexit in the United Kingdom and the European Union

    Open Access•Valérie Pattyn, Athanassios Gouglas et al.•Journal of European Public Policy•2021

  • The future might be female

    Open Access•Pirmin Bundi, Anina Hanimann et al.•Journal of European Public Policy•2025

  • Why National Ministries Consider the Policy Advice of International Bureaucracies

    Open Access•Jana Herold, Andrea Liese et al.•International Studies Quarterly•2021

  • Network dynamics in public health advisory systems

    Open Access•Antoine Lemor, Éric Montpetit et al.•Governance•2025

  • Conceptualising the policy engagement of interest groups

    Open Access•Darren Halpin, Darren R Halpin et al.•European Journal of Political…•2017

  • Behavioural Insights and Public Policy in Canada

    Open Access•Vincent Hopkins, Andrea Lawlor•Canadian Journal of Political…•2023

  • Do Citizens Judge Health Experts Through a Partisan Lens? Evidence from a Factorial Survey Experiment

    Open Access•Anina Hanimann•Swiss Political Science Review•2023

  • Policy advisory systems and public policy making

    Open Access•Feryad Hussain, Fiaz Hussain et al.•Review of Policy Research•2024

  • Scientific expertise and political accountability

    P Weingart•Science and Public Policy•1999

  • How to Make More Published Research True

    Open Access•John P A Ioannidis, John C Biery et al.•PLoS Medicine•2014

  • Who's Afraid of Peer Review?

    Open Access•John Bohannon•Science•2013

  • Manufactured Scientific Controversy

    Luca Ceccarelli, Leah Ceccarelli•Rhetoric and Public Affairs•2011

  • Policy Advice and the Public Service

    John Halligan•Governance in a Changing…•1995

  • Policy Analysis in Canada

    David H Laycock, Laurent Dobuzinskis et al.•Policy Analysis in Canada•2007

  • Introduction to Political Psychology

    Martha L Cottam, Elena Mastors et al.•Introduction to Political…•2010

  • Great Transformations

    Open Access•Mark Blyth, M A Wynter-Blyth•Great Transformations•2002

  • Expert‐Based Information and Policy Subsystems

    Open Access•Christopher M Weible•Policy Studies Journal•2008

  • Bounded rationality in social science

    Open Access•Herbert A Simon•Mind & Society•2000

  • Public Managers as the Missing Variable in Policy Studies

    Open Access•Michael Howlett•Review of Policy Research•2011

  • Rethinking the relationship between technical and local knowledge

    Open Access•Maya Negev, Na''Ama Teschner•Environmental Science & Policy•2012

  • Constructing sustainability in EU fisheries

    Open Access•Caitríona A Carter•Environmental Science & Policy•2012

  • Technical knowledge, discursive spaces and politics at the science–policy interface

    Open Access•Anna Wesselink, Karen Buchanan et al.•Environmental Science & Policy•2013

  • Are policy-makers interested in social research? Exploring the sources and uses of valued information among public servants in Australia

    Open Access•Bessie Head, Brian Head et al.•Policy and Society•2014

  • The dual dynamics of policy advisory systems

    Open Access•Jonathan Craft, Michael Howlett•Policy and Society•2013

  • British Think Tanks

    Open Access•Philippa Sherrington•The British Journal of Politics…•2000

  • Think Tanks in the U.S. Media

    Open Access•Andrew Rich, R Kent Weaver•Harvard International Journal of…•2000

  • Think Tanks and the Web

    Kathleen Mcnutt, Gregory Marchildon•Canadian Public Policy•2009

  • A New Era for Think Tanks in Public Policy? International Trends, Australian Realities

    Open Access•Paul ‘t Hart, Ariadne Vromen•Australian Journal of Public…•2008

  • Ministerial Advisers and the Politics of Policy‐Making

    Open Access•Chris Eichbaum, Richard Shaw•Australian Journal of Public…•2007

  • The Information-Seeking Behavior of Local Government Officials

    Open Access•Marc A Levin•The American Review of Public…•1991

  • Credibility Logic and Policy Analysis

    Open Access•David Landsbergen, Barry Bozeman•Knowledge•1987

  • Performing fleas

    James Cornford•Policy Studies•1990

  • The Many Meanings of Research Utilization

    CAROL H WEISS•Public Administration Review•1979

  • Prescriptions for Regional Economic Dilemmas

    Open Access•Peter Wells•Public Administration•2011

  • Recycling Bins, Garbage Cans or Think Tanks? Three Myths Regarding Policy Analysis Institutes

    Open Access•Diane Stone•Public Administration•2007

  • The Order of Questions in a Survey on Citizen Satisfaction With Public Services

    Open Access•Steven Van De Walle, Gregg G Van Ryzin•Public Administration•2011

  • Think Tanks, Public Policy, and the Politics of Expertise

    Open Access•Donald E Abelson, Donald Abelson•Political Science Quarterly•2005

  • The political use of knowledge in the policy process

    Open Access•Falk Daviter•Policy Sciences•2015

  • Think tanks and strategic policy-making

    Open Access•Bert Fraussen, Darren Halpin•Policy Sciences•2016

  • Think tanks or clubs? Assessing the influence and roles of Canadian policy institutes

    Open Access•Evert A Lindquist•Canadian Public Administration•1993

  • What Works'? British Think Tanks and the 'End of Ideology

    Open Access•Andrew Denham, Mark Garnett•The Political Quarterly•2006

  • The Real but Limited Influence of Expert Ideas

    Open Access•Johannes Lindvall•World Politics•2009

  • From the margins of politics

    Diane Stone•West European Politics•1996

  • Does Morality Policy Exist? Testing a Basic Assumption

    Open Access•Christopher Z Mooney, Richard G Schuldt•Policy Studies Journal•2008

  • Policy Knowledge, Policy Formulation, and Change

    Open Access•Thomas E James, Paul D Jorgensen et al.•Policy Studies Journal•2009

  • Public Perceptions of Expert Credibility on Policy Issues

    Open Access•Erick Lachapelle, Éric Montpetit et al.•Policy Studies Journal•2014

  • The Cognitive Revolution and the Political Psychology of Elite Decision Making

    Open Access•Emilie M Hafner-Burton, Emilie M Hafner‐burton et al.•Perspectives on Politics•2013

  • Policy formulation, governance shifts and policy influence

    Open Access•Jonathan Craft, Michael Howlett•Journal of Public Policy•2012

  • Conceptualising Advisers' Policy Work

    Maria Maley•Australian Journal of Political…•2000

  • Demanding Information

    Open Access•Anthony M Bertelli, Jeffrey B Wenger•British Journal of Political…•2009

  • Policy Paradigms, Social Learning, and the State

    Peter A Hall•Comparative Politics•1993

  • The organisation of denial

    Peter J Jacques, Peter Jacques et al.•Environmental Politics•2008

  • Measuring the Influence of Think Tanks

    Open Access•Murray Weidenbaum, Murray L Weidenbaum•Society•2010

Unique citing works29
Citations per year3,22
Citation span2017 - 2026 (10)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 29

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae