Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Truth Tests and Utility Tests

Decision-Makers' Frames of Reference for Social Science Research

Bibliographic Data

ID5250359
AuthorsCarol H Wei, CAROL H WEISS, Michael J Bucuvalas
Year1980
Volume45
Issue2
Pages302
Publication date1980-04-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueAmerican Sociological Review (JOURNAL)
Journal identifiersISSN: 0003-1224 • E-ISSN: 1939-8271
PublisherSAGE Publications Inc (PUBLISHER)
DOI10.2307/2095127
OpenAlexW2328749703
LanguageEN
Citations received123
References cited6

In an effort to contribute to an empirically based sociology of knowledge application, this paper explores the frames of reference that decision-makers employ in assessing the usefulness of social science research for their work. Analysis of responses of 155 decision-makers in mental health fields to 50 actual research reports reveals five frames of reference: relevance of research topic, research quality, conformity of results with expectations, orientation to action, and challenge to existing policy. All frames are positively associated with perceived likelihood of using a study. Two significant interactions among the frames suggest that, in essence, decision-makers apply a test and a test in screening social science research. They judge truth on two bases: research quality and/or conformity with prior knowledge and expectations. They also assess utility on alternaive bases: feasible direction for action and/or challenge to current policy. The ways in which they apply research conclusions to their work is a broader, more diffuse, and wider-ranging process than many earlier investigators have recognized. In 1949, Robert Merton called for systematic study of applied social science and of the factors that facilitated or impeded its utilization for purposes of practical action. His luminous analysis discussed the cultural, organizational, situational, and cognitive contexts of applied social research and pointed to the need for empirical investigation of their implications for research use. He identified such dimen

Economics · Management science · Political science · Sociology · Test (biology · Evaluation and Performance Assessment · Psychology · Social Psychology

  • Para Pensar a Avaliação de Políticas Públicas de Esporte e Lazer

    Open Access•Edmilson Santos Dos Santos•LICERE - Revista do Programa de…•2014

  • Forms of communicated knowledge and their effects on Australian teachers

    Open Access•John M Owens, John M Owen•Studies In Educational Evaluation•1983

  • Health policy-makers' perceptions of their use of evidence

    Open Access•Simon Innvær, Gunn Elisabeth Vist et al.•Journal of Health Services…•2002

  • Biases in the Interpretation and Use of Research Results

    Robert J Maccoun•Annual Review of Psychology•1998

  • The utilisation of health research in policy-making

    Open Access•Steve Hanney, Stephen R Hanney et al.•Health Research Policy and Systems•2003

  • Knowledge Exchange Processes in Organizations and Policy Arenas: A Narrative Systematic Review of the Literature

    Open Access•Damien Contandriopoulos, Marc Lemire et al.•Milbank Quarterly•2010

  • Reconceptualizing evaluation use

    Open Access•Karen E Kirkhart•New Directions for Evaluation•2000

  • Weather Forecasts are for Wimps

    Open Access•Steve Rayner, Denise Lach et al.•Climatic Change•2005

  • Evaluation Von Programmen und Projekten Für eine Demokratische Kultur

    Rainer Strobl, Olaf Lobermeier et al.•Evaluation Von Programmen und…•2012

  • Getting results used

    Open Access•Carlos Brambila, Emma Ottolenghi et al.•Health Policy and Planning•2007

  • Advancing equity via research-practice partnerships

    Open Access•R O Welsh, Kathryn James McGraw•Frontiers in Education•2025

  • How are mathematical models and results from mathematical models of vaccine-preventable diseases used, or not, by global health organisations

    Open Access•Paula Christen, Lesong Conteh•BMJ Global Health•2021

  • Evidence based education policy in Ireland

    John S O’connor•Irish Educational Studies•2024

  • Useful to whom? Evaluation utilisation theory and boundaries for programme evaluation scope

    Open Access•Betty Onyura•Medical Education•2020

  • Using outcome measures in sub-national level performance management

    Open Access•Pushkar Raj Silwal, Pushkar Silwal et al.•Health Policy•2025

  • Research Worth Using

    Open Access•Norma Ming, Lauren B Goldenberg•Review of Research in Education•2021

  • Evidence-based practice and the management of risk in nursing

    Beverley French•Health Risk & Society•2005

  • Further reflections on evaluation misutilization

    Open Access•Christina A Christie, Marvin C Alkin•Studies In Educational Evaluation•1999

  • Evaluation at the University Level

    Alan Ryan, Bikkar S Randhawa•Assessment & Evaluation in Higher…•1982

  • Knowledge in Use

    Open Access•Burkart Holzner, Evelyn M Fisher et al.•Knowledge•1979

  • Knowledge Utilization as Planned Social Change

    Open Access•Gerald Zaltman•Knowledge•1979

  • Type, frequency and purpose of information used to inform public health policy and program decision-making

    Open Access•Pauline Zardo, Alex Collie•BMC Public Health•2015

  • Impact of a university-government partnership in criminal justice

    Knowlton Johnson, Knowlton W Johnson•Journal of Criminal Justice…•1990

  • Assessing the Quality of Aboriginal Program Evaluations

    Steve Jacob, Geoffroy Desautels•Canadian Journal of Program…•2014

  • Measuring research influence on drug policy

    Open Access•A Ritter, K Lancaster•International Journal of Drug…•2013

  • Sport and Social Inclusion

    Open Access•Fred Coalter•Social Inclusion•2017

  • How perceptions of voter control affect politicians’ evaluations of expertise in the news

    Anina Hanimann•Evidence & Policy•2023

  • Maybe we can turn the tide’

    Open Access•Theresa Norton, Daniela C Rodríguez et al.•Evidence & Policy•2019

  • Knowledge Utilisation Analysis

    Jonas Videbæk Jørgensen•Evidence & Policy•2023

  • Does evaluation quality enhance evaluation use

    Pirmin Bundi, Kathrin Frey et al.•Evidence & Policy•2021

  • Evidence‐Based Policymaking and Spatial Planning. Factors of Evidence Utilization

    Open Access•Martino Mazzoleni, Matilde Zubani•Review of Policy Research•2025

  • After Katrina

    Open Access•Xavier De Souza Briggs•City and Community•2006

  • Discursive power in deliberations

    Open Access•Tamara Metze, Tamara A P Metze•Policy and Society•2009

  • Government science in forestry

    Open Access•Nicole L Klenk, Nicole Klenk et al.•Forest Policy and Economics•2010

  • Knowledge use and learning in everyday social work practice

    Open Access•Gunilla Avby, Phoebe Nilsen et al.•Child & Family Social Work•2015

  • Resistance to Evaluation

    Open Access•Sandy Taut, Dieter Brauns•Evaluation•2003

  • A Vision of Evaluation that Strengthens Democracy

    Open Access•Michael Quinn Patton•Evaluation•2002

  • Evaluation Utilization as Argumentation

    Open Access•Ville Valovirta•Evaluation•2002

  • Evaluating the Benefits from Health Research and Development Centres

    Open Access•Steve Hanney, Tim Packwood et al.•Evaluation•2000

  • The Influence of Evaluation on Changing Management Systems in Educational Institutions

    Open Access•Enrique Rebolloso, Baltasar Fernández-Ramírez et al.•Evaluation•2005

  • Evaluation models and evaluation use

    Open Access•Damien Contandriopoulos, Astrid Brousselle•Evaluation•2012

  • Trailing Research

    Open Access•Håkon Finne, Morten Levin et al.•Evaluation•1995

  • The use of social science research to inform policy development

    Open Access•Michael Blewden, Penelope Carroll et al.•Kōtuitui New Zealand Journal of…•2010

  • A Decade of Research on Evaluation

    Open Access•Chris L S Coryn, Lyssa N Wilson et al.•American Journal of Evaluation•2017

  • The Game of Knowledge Brokering

    Open Access•Karol Olejniczak•American Journal of Evaluation•2017

  • Understanding Evaluation Influence Within Public Sector Partnerships

    Open Access•Sarah Appleton-Dyer, Joshua Clinton et al.•American Journal of Evaluation•2012

  • Quality, Context, and Use

    Open Access•Leslie J Cooksy, Valerie J Caracelli•American Journal of Evaluation•2005

  • Does Research on Evaluation Matter? Findings From a Survey of American Evaluation Association Members and Prominent Evaluation Theorists and Scholars

    Open Access•Chris L S Coryn, Satoshi Ozeki et al.•American Journal of Evaluation•2015

  • Exploring the Necessary Conditions for Evaluation Use in Program Change

    Open Access•Simone Ledermann•American Journal of Evaluation•2011

  • On the Life and Death Importance of Thinking

    Open Access•Michael Quinn Patton•American Journal of Evaluation•2018

  • Definitions of Evaluation Use and Misuse, Evaluation Influence, and Factors Affecting Use

    Open Access•Marvin C Alkin, Jean A King•American Journal of Evaluation•2017

  • Revising Swiss Policies

    Open Access•Kathrin Frey, Thomas Widmer•American Journal of Evaluation•2011

  • Knowledge Competition and Personal Ambition

    Open Access•Glenn Hultman, Cristina Robertson Hörberg•Science Communication•1998

  • Mechanisms Shaping an Evaluation System—A Case Study of Poland 1999–2010

    Karol Olejniczak•Europe Asia Studies•2013

  • Advising national climate policy makers

    Open Access•Harriet Dudley, Andrew J Jordan et al.•Global Environmental Change•2022

  • Sociological research and social policy

    Open Access•M A Straus•Sociological Forum•1992

  • The use of performance feedback in school improvement in Louisiana

    Open Access•Kim Schildkamp, Adrie J Visscher et al.•Teaching and Teacher Education•2010

  • Evidence‐Based Policymaking – Speaking Truth to Power

    Open Access•Bessie Head•Australian Journal of Public…•2013

  • NSW Workers’ Compensation Reform

    Open Access•Sasha Holley, Louise Thornthwaite et al.•Australian Journal of Public…•2015

  • Relationships between Policy Academics and Public Servants

    Open Access•Bessie Head•Australian Journal of Public…•2015

  • Awareness and use of systematic literature reviews and meta‐analyses by ministerial policy analysts

    Open Access•Pierre‐olivier Bédard, Mathieu Ouimet•Canadian Public Administration•2017

  • Does Research Reduce Poverty? Assessing the Impacts of Policy-oriented Research in Agriculture

    Open Access•Andy Sumner, Edoardo Masset et al.•IDS Bulletin•2010

  • Credibility Logic and Policy Analysis

    Open Access•David Landsbergen, Barry Bozeman•Knowledge•1987

  • Measuring Knowledge Use

    Open Access•William N Dunn•Knowledge•1983

  • Commissions and the Use of Social Science Research

    Open Access•Karen Seashore Louis, Robert Perlman et al.•Knowledge•1985

  • Research Influence in Decision Making to Control and Prevent Violence

    Open Access•Knowlton Johnson, Knowlton W Johnson•Knowledge•1985

  • The Use of Information by Policymakers at the Local Community Level

    Open Access•Evelyn Florio, Joseph R Demartini•Knowledge•1993

  • Case Studies and Organizational Innovation

    Open Access•Robert K Yin, Peter G Bateman et al.•Knowledge•1985

  • Knowledge, Policy-Oriented Learning, and Policy Change

    Open Access•Paul A Sabatier, Paul Sabatier•Knowledge•1987

  • Program Evaluation within the Paradigms

    Open Access•Alan Ryan, Alan G Ryan•Knowledge•1988

  • Reforms as A rguments

    Open Access•William N Dunn•Knowledge•1982

  • Underutilized Research

    Open Access•Andrew D Seidel•Knowledge•1981

  • Explaining Research Utilization

    Open Access•Sune Sunesson, KJELL NILSSON•Knowledge•1988

  • Policy as Communication and the Naturalistic Study of the Use of Policy Research

    Open Access•Steven Maynard-Moody, Steven Maynard‐moody•Knowledge•1989

  • Acquiring Knowledge of Implementation and Change

    Open Access•John M Owens, John M Owen et al.•Knowledge•1994

  • Knowledge Utilization as a Networking Process

    Open Access•Robert K Yin, Margaret K Gwaltney•Knowledge•1981

  • A ction and Enlightenment Functions of Research

    Open Access•Rohit Deshpandé•Knowledge•1981

  • Research, politics, and resource management decisions

    Bo Shelby•Leisure Sciences•1981

  • Structural Equation Modeling in Practice

    Knowlton Johnson, Knowlton W Johnson•Journal of Social Service Research•1999

  • Increasing the policy and program relevance of results from randomized trials of home visitation

    Open Access•David Olds, David L Olds et al.•Journal of Community Psychology•1998

  • Psychology and the Art of Programme Evaluation

    Open Access•Charles Potter•South African Journal of Psychology•2006

  • Evaluating Practice

    Elizabeth Mutschler•Social Work•1984

  • The Extent and Determinants of the Utilization of University Research in Government Agencies

    Open Access•Réjean Landry, Moktar Lamari et al.•Public Administration Review•2003

  • Public‐Value Failure

    Open Access•Barry Bozeman•Public Administration Review•2002

  • Policy Change and Expert Involvement in China

    Open Access•Xufeng Zhu•Public Administration•2012

  • University-Based Policy Centers

    Martha M Mccarthy•Educational Researcher•1990

  • Issues in the Definition and Measurement of the Giftedness Construct

    Open Access•Robert D Hoge•Educational Researcher•1988

  • Public administration in the cross‐hairs of evidence‐based policy and authentic engagement

    Open Access•Carolyn Johns, Duncan Maclellan•Canadian Public Administration•2020

  • How to Maximize Utilization of Evaluation Research by Policymakers

    Open Access•Douglas S Lipton•The Annals of the American…•1992

  • Evolving Research Perspectives on Education Politics and Policy

    Open Access•Lorraine M Mcdonnell•Educational Researcher•2016

  • Research news and Comment

    Open Access•Martha M Mccarthy•Educational Researcher•1990

  • The 1988 Presidential Address Contributions of Educational Research to Policy and Practice

    Open Access•Richard J Shavelson•Educational Researcher•1988

  • Policy Relevance and the Future of Criminology—the American Society of Criminology. 1990 Presidential Address

    Open Access•Joan Petersilia•Criminology•1991

  • Bringing Sociology into the Public Policy Process

    Open Access•Roberta Spalter-Roth, Amy L Best et al.•The American Sociologist•2018

  • Policy Research in the Context of Diffuse Decision Making

    CAROL H WEISS•The Journal of Higher Education•1982

  • Observations on the State of Comparative Administration Research in Europe — Rather Comparable than Comparative

    Open Access•Hans‐ulrich Derlien•Governance•1992

  • Die journalistische Verwendung sozialwissenschaftlichen Wissens und ihre Bedeutung für gesellschaftliche Diskurse

    Open Access•Hartmut Wessler•Publizistik•1995

  • (Un)anticipated Effects of Sentencing Reform on the Disparate Treatment of Defendants

    Open Access•John Wooldredge, Timothy Griffin et al.•Law & Society Review•2005

  • Two Decades of Developments in Qualitative Inquiry

    Open Access•Michael Quinn Patton•Qualitative Social Work•2002

  • The Case Study as a Serious Research Strategy

    Open Access•Robert K Yin•Knowledge•1981

  • Social science and public policy

    Martin Rein•Social science and public policy•1976

  • Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences

    Jacob Cohen, Patricia Cohen et al.•Applied Multiple Regression/Correla…•2014

  • An Introduction to Applied Sociology

    Michael Hennessy, Paul F Lazarsfeld et al.•Contemporary Sociology A Journal…•1977

  • The Role of Applied Social Science in the Formation of Policy

    Open Access•Robert Κ Merton, Robert K Merton•Philosophy of Science•1949

  • Social science mandarins

    Open Access•Irving Louis Horowitz•Policy Sciences•1970

  • Political Conflict

    Sandor Halebsky, Morris Janowitz•Social Forces•1972

Unique citing works123
Citations per year2,62
Citation span1979 - 2025 (47)
Citation velocityrecent
Highly citedYes
Citation typesNeutral: 121

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae