Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Developing Evaluation Indicators to Improve the Process of Coproducing Usable Climate Science

Bibliographic Data

ID22332159
AuthorsTamara U Wall (Division of Atmospheric Sciences, Desert Research Institute, Reno, Nevada), Tamara Wall (0000-0003-4259-1841, Desert Research Institute, corresponding author), Alison M Meadows (0000-0003-0315-5799, University of Arizona), Alison M Meadow (Institute for the Environment, University of Arizona, Tucson, Arizona), Alexandra Horganic (University of Arizona)
Year2017
Volume9
Issue1
Pages95-107
Publication date2017-01-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueWeather, Climate, and Society (JOURNAL)
Journal identifiersISSN: 1948-8327 • E-ISSN: 1948-8335
PublisherAmerican Meteorological Society (PUBLISHER • US)
DOI10.1175/wcas-d-16-0008.1
OpenAlexW2536252402
LanguageEN
Citations received75
References cited48

Resource managers and decision-makers are increasingly tasked with integrating climate change science into their decisions about resource management and policy development. This often requires climate scientists, resource managers, and decision-makers to work collaboratively throughout the research processes, an approach to knowledge development that is often called “coproduction of knowledge.” The goal of this paper is to synthesize the social science theory of coproduction of knowledge, the metrics currently used to evaluate usable or actionable science in several federal agencies, and insights from experienced climate researchers and program managers to develop a set of 45 indicators supporting an evaluation framework for coproduced usable climate science. Here the proposed indicators and results from two case studies that were used to test the indicators are presented, as well as lessons about the process of evaluating the coproduction of knowledge and collaboratively producing climate knowledge

Business · Climate change · Climate science · Coproduction · Environmental resource management · Knowledge management · Political science · Public relations · Science policy · USable · Climate Change Communication and Perception · Computer Science · Engineering · Environmental Science · Evaluation and Performance Assessment · Sustainability and Climate Change Governance · Ecology

  • Our Wastewater Footprint

    Toni M Groet, Elizabeth E Hieb et al.•Case Studies in the Environment•2021

  • Capacity development for locally-led knowledge co-production processes in Real World Labs for managing climate and disaster risk

    Open Access•Lydia Cumiskey, Janne Parviainen et al.•International Journal of Disaster…•2025

  • Engaging with complexity in resilience practice

    Open Access•My M Sellberg, Allyson Quinlan et al.•Conservation Ecology•2021

  • A synthesis of the frameworks available to guide evaluations of research impact at the interface of environmental science, policy and practice

    Open Access•Elena Louder, Carina Wyborn et al.•Environmental Science & Policy•2020

  • A critical approach to co‐producing knowledge for development

    Open Access•Ryan Nehring, Fernando Galeana et al.•Development Policy Review•2025

  • Knowledge Co-production in Contested Spaces

    Open Access•Nathan P Kettle•ARCTIC•2019

  • The art of co-production of knowledge in environmental sciences and management

    Open Access•I N S Djenontin, Alison M Meadows•Environmental Management•2018

  • Scientist-stakeholder relationships drive carbon data product transfer effectiveness within Nasa program

    Open Access•Molly E Brown, Vanessa M Escobar et al.•Environmental Research Letters•2022

  • Science-based communication and education needed to improve forest carbon science, policy, and management outcomes

    Open Access•Chad Papa, Kylie Clay et al.•Environmental Research Letters•2025

  • Co-production trajectories

    Open Access•Sonja K Nielsen, Hyysalo et al.•Science and Public Policy•2026

  • Delivering and Evaluating Climate Services

    Open Access•Tonya Haigh, Douglas R Kluck et al.•Weather, Climate, and Society•2024

  • User Engagement Testing with a Pilot Decision Support Tool Aimed to Support Species Managers

    Open Access•Haven J Cashwell, Karen S McNeal et al.•Weather, Climate, and Society•2023

  • Perceptions of Climate Risk and Use of Climate Risk Information by Natural Resource Conservation Stakeholders Participating in Advance Projects in Asia and Latin America

    Manishka De Mel, William Solecki et al.•Weather, Climate, and Society•2021

  • An Evaluation of the Utility of a Decision-Maker-Driven Climate Hazard Assessment Tool

    Rachel Riley, Rachel E Riley•Weather, Climate, and Society•2021

  • Weather, Climate, and Society

    Open Access•Prakoso Bhairawa Putera, Ieke Sartika Iriany et al.•Weather, Climate, and Society•2024

  • Integrating Farmers’ Perspectives into Earth System Model Development

    Open Access•Kelsey Emard, Olivia Cameron et al.•Weather, Climate, and Society•2024

  • Cooperation without Consensus

    David C Eisenhauer•Weather, Climate, and Society•2021

  • Making the Transition from Science Delivery to Knowledge Coproduction in Boundary Spanning

    Open Access•Melanie M Colavito, Sarah F Trainor et al.•Weather, Climate, and Society•2019

  • The Closer, the Better? Untangling Scientist–Practitioner Engagement, Interaction, and Knowledge Use

    Open Access•Maria Carmen Lemos, Kimberly S Wolske et al.•Weather, Climate, and Society•2019

  • Engaging with stakeholders to produce actionable science

    Aparna Bamzai-Dodson, Amanda E Cravens et al.•Weather, Climate, and Society•2021

  • Inconvenience versus Rationality

    Open Access•Andrzej Ceglarz, Rasmus Benestad et al.•Weather, Climate, and Society•2018

  • Coconstruction of Ecosystem Services Management in Tribal Lands

    Alicia Azpeleta Tarancón, Yeon‐su Kim et al.•Weather, Climate, and Society•2020

  • Improving China’s Resilience to Climate-Related Risks

    Open Access•Yujie Wang, Lianchun Song et al.•Weather, Climate, and Society•2020

  • Co-producing “Post-normal” Climate Knowledge with Communities in Northeast Bangladesh

    Open Access•Sina Bremer, Mathew Stiller-Reeve et al.•Weather, Climate, and Society•2018

  • Building a Framework for Process-Oriented Evaluation of Regional Climate Outlook Forums

    Open Access•Andrea K Gerlak, Zack Guido et al.•Weather, Climate, and Society•2018

  • Eliciting mental models of science and risk for disaster communication

    Open Access•Emma E H Doyle, Sara Harrison et al.•International Journal of Disaster…•2022

  • Addressing power imbalances in co-production

    Open Access•Katharine Vincent, Suzanne Carter et al.•Nature Climate Change•2020

  • Climate services promise better decisions but mainly focus on better data

    Open Access•Kieran Findlater, Sabra Webber et al.•Nature Climate Change•2021

  • Understanding and evidencing a broader range of ‘successes’ that can occur at the interface of marine science and policy

    Open Access•Christopher Cvitanovic, Mary Mackay et al.•Marine Policy•2021

  • Best bang for your buck

    Open Access•Denis B Karcher, Christopher Cvitanovic et al.•Marine Policy•2025

  • Social learning lessons from Collaborative Adaptive Rangeland Management

    Open Access•Hailey Wilmer, Terri Schulz et al.•Rangelands•2022

  • Co-production of public policy to mitigate animal-vehicle collisions on roads in Brazil

    Larissa Oliveira Gonçalves, Thales Andrés Carra et al.•Impact Assessment and Project…•2025

  • Who are boundary spanners and how can we support them in making knowledge more actionable in sustainability fields

    Open Access•Kristen A Goodrich, Kathryn Dana Sjostrom et al.•Current Opinion in Environmental…•2020

  • Great expectations? Reconciling the aspiration, outcome, and possibility of co-production

    Open Access•Kripa Jagannathan, James Arnott et al.•Current Opinion in Environmental…•2020

  • Actionable knowledge and the art of engagement

    Open Access•Katharine J Mach, Maria Carmen Lemos et al.•Current Opinion in Environmental…•2020

  • Sponsoring actionable science

    Open Access•James Arnott, Christine Kirchhoff et al.•Current Opinion in Environmental…•2020

  • Caution as a Response to Scientific Uncertainty

    Open Access•Minwoo Ahn, E Baldwin et al.•International Journal of the…•2024

  • Is this what success looks like? Mismatches between the aims, claims, and evidence used to demonstrate impact from knowledge exchange processes at the interface of environmental science and policy

    Open Access•Denis B Karcher, Christopher Cvitanovic et al.•Environmental Science & Policy•2021

  • Wildfire narratives

    Open Access•Michal Russo, Alexandra Paige Fischer et al.•Environmental Science & Policy•2024

  • Redefining co-design for social-ecological research and practice

    Open Access•Mairéad O’Donnell, Marcus Collier et al.•Environmental Science & Policy•2025

  • Effectiveness factors and impacts on policymaking of science-policy interfaces in the environmental sustainability context

    Open Access•Niklas Wagner, Sara Velander et al.•Environmental Science & Policy•2022

  • Lessons learned in knowledge co-production for climate-smart decision-making

    Open Access•Alyssa Rosemartin, Theresa M Crimmins et al.•Environmental Science & Policy•2023

  • Development of a survey instrument to assess individual and organizational use of climate adaptation science

    Open Access•Steph L Courtney, Amanda A Hyman et al.•Environmental Science & Policy•2022

  • Understanding knowledge use for sustainability

    Open Access•James Arnott, James C Arnott et al.•Environmental Science & Policy•2021

  • From “atmosfear” to climate action

    Open Access•Zbigniew W Kundzewicz, Piotr Matczak et al.•Environmental Science & Policy•2019

  • Co-producing knowledge

    Open Access•Jack Covey, D Macqueen et al.•Environmental Science & Policy•2021

  • Does knowledge co-production influence adaptive capacity

    Open Access•Rebecca Witinok-Huber, Corrine N Knapp et al.•Environmental Science & Policy•2025

  • Assessment of adaptation, policy, and capacity building outcomes from 14 processes

    Open Access•Seth Tuler, Seth P Tuler et al.•Environmental Science & Policy•2020

  • Appraising science-policy interfaces in local climate change policymaking

    Open Access•Mehmet Eroğlu, Aslı Öğüt Erbil•Environmental Science & Policy•2021

  • Loops and Building Blocks

    Open Access•Camilla Audia, Frans Berkhout et al.•Journal of Urban Health•2021

  • Typologies of actionable climate information and its use

    Open Access•Kripa Jagannathan, Smitha Buddhavarapu et al.•Global Environmental Change•2023

  • Preparing for the health impacts of climate change in Indigenous communities

    Open Access•James D Ford, Mya Sherman et al.•Global Environmental Change•2018

  • Engagement, involvement and empowerment

    Open Access•Dragana Bojović, Asuncion Lera St Clair et al.•Global Environmental Change•2021

  • Co-producing science for sustainability

    Open Access•James Arnott, Rachel J Neuenfeldt et al.•Global Environmental Change•2019

  • Building Community for Participatory Modeling

    Open Access•Wendy-Lin Bartels, Wendy‐lin Bartels et al.•Society & Natural Resources•2023

  • How agricultural producers use local knowledge, climate information, and on-farm “experiments” to address drought risk

    Open Access•Adam J Snitker, Laurie Yung et al.•Agriculture and Human Values•2024

  • Stakeholder engagement in the co-production of knowledge for environmental decision-making

    Open Access•Andrea K Gerlak, Zack Guido et al.•World Development•2023

  • Can insurance catalyse government planning on climate? Emergent evidence from Sub-Saharan Africa

    Open Access•Swenja Surminski, Jonathan Barnes et al.•World Development•2022

  • Principles for knowledge co-production in sustainability research

    Open Access•Albert V Norström, Christopher Cvitanovic et al.•Nature Sustainability•2020

  • Scaling up co-produced climate-driven decision support tools for agriculture

    Open Access•Junyu Lu, Maria Carmen Lemos et al.•Nature Sustainability•2021

  • To co-produce or not to co-produce

    Open Access•Maria Carmen Lemos, James Arnott et al.•Nature Sustainability•2018

  • Climate services in a rapidly changing environment

    Open Access•Nathan P Kettle, A Hendricks et al.•Polar Geography•2023

  • Fostering inter- and transdisciplinarity in discipline-oriented universities to improve sustainability science and practice

    Open Access•Pedro Luís Bernardo Da Rocha, Renata Pardini et al.•Sustainability Science•2019

  • Assessing imidacloprid for Nantucket pine tip moth (Rhyacionia frustrana) suppression through regional collaborative research and focus group evaluation

    Open Access•E P McCarty, Richard Kent Evans et al.•Trees Forests and People•2021

  • Embracing complexity in landscape management

    Open Access•Katja Malmborg, Elin Enfors-Kautsky et al.•Ecosystems and People•2022

  • Knowledge co-production in the Helge å catchment

    Open Access•Katja Malmborg, Ida Wallin et al.•Ecosystems and People•2022

  • Evaluating stakeholder engagement in collaborative research

    Open Access•Loretta Singletary, Elizabeth A Koebele et al.•Socio-Ecological Practice Research•2022

  • Insights from a novel, user-driven science transfer program for resource management

    Open Access•Julie L M Hinderer, Z Blevins et al.•Socio-Ecological Practice Research•2021

  • Facilitating use of climate information for adaptation actions in small coastal communities

    Open Access•Vanessa R Levesque, Cameron P Wake et al.•Elementa Science of the…•2021

  • Climate action from a gender perspective

    Open Access•E Alonso-Epelde, X García-Muros et al.•Energy Research & Social Science•2024

  • Participation and co‐production in climate adaptation

    Open Access•Julian V Sartorius, Alistair Geddes et al.•Wiley Interdisciplinary Reviews…•2024

  • Evaluating the impacts of boundary-spanning activities at the interface of environmental science and policy

    Open Access•Stephen Posner, Stephen M Posner et al.•Environmental Science & Policy•2019

  • Beyond “linking knowledge and action”

    Open Access•West, Lorrae Van Kerkhoff et al.•Policy Studies•2019

  • Justice in energy transitions

    Open Access•Stephen Williams, Andreanne Doyon•Environmental Innovation and…•2019

  • Critical Stakeholder Engagement

    Open Access•Aparna Bamzai-Dodson, Amanda E Cravens et al.•Annals of the American…•2024

  • The Sage Encyclopedia of Qualitative Research Methods

    Lisa M Given, Lisa Given•The Sage Encyclopedia Of…•2008

  • Introduction to Action Research

    Davydd J Greenwood, Davydd Greenwood et al.•Introduction to Action Research•2007

  • Crafting usable knowledge for sustainable development

    Open Access•William C Clark, Lorrae Van Kerkhoff et al.•Proceedings of the National…•2016

  • Measuring societal effects of transdisciplinary research projects

    Open Access•Alexander I Walter, Sebastian Helgenberger et al.•Evaluation and Program Planning•2007

  • Five principles for the practice of knowledge exchange in environmental management

    Open Access•Myer S Reed, L C Stringer et al.•Journal of Environmental Management•2014

  • Climate Change Impacts in the United States

    Jerry M Melillo, Terese Richmond et al.•2014

  • Improving knowledge exchange among scientists and decision-makers to facilitate the adaptive governance of marine resources

    Open Access•Christopher Cvitanovic, Alistair J Hobday et al.•Ocean & Coastal Management•2015

  • The Quality of Stakeholder‐Based Decisions

    Open Access•Thomas C Beierle•Risk Analysis•2002

  • Knowledge systems for sustainable development

    Open Access•David W Cash, William C Clark et al.•Proceedings of the National…•2003

  • Stakeholder participation for environmental management

    Open Access•Mark S Reed•Biological Conservation•2008

  • Moving toward the Deliberate Coproduction of Climate Science Knowledge

    Alison M Meadows, Alison M Meadow et al.•Weather, Climate, and Society•2015

  • Making Science Useful to Decision Makers

    David L Feldman, Herbert Ingram et al.•Weather, Climate, and Society•2009

  • Delivering Climate Services

    Open Access•Elizabeth Mcnie, Elizabeth C McNie•Weather, Climate, and Society•2012

  • Actionable Knowledge for Environmental Decision Making

    Open Access•Christine Kirchhoff, Maria Carmen Lemos et al.•Annual Review of Environment and…•2013

  • Community‐based adaptation research in the Canadian Arctic

    Open Access•James D Ford, Ellie Stephenson et al.•Wiley Interdisciplinary Reviews…•2016

  • Transdisciplinarity

    Open Access•Thomas Jahn, Matthias Bergmann et al.•Ecological Economics•2012

  • Developing and applying a framework to evaluate participatory research for sustainability

    Open Access•Kirsty Blackstock, K L Blackstock et al.•Ecological Economics•2007

  • Framework for participative reflection on the accomplishment of transdisciplinary research programs

    Open Access•Dirk J Roux, Richard Stirzaker et al.•Environmental Science & Policy•2010

  • Conceptualising joint knowledge production in regional climate change adaptation projects

    Open Access•Dries Hegger, D L T Hegger et al.•Environmental Science & Policy•2012

  • Reconciling the supply of scientific information with user demands

    Open Access•Elizabeth Mcnie, Elizabeth C McNie•Environmental Science & Policy•2006

  • Evaluating knowledge exchange in interdisciplinary and multi-stakeholder research

    Open Access•I Fazey, Lukas Bunse et al.•Global Environmental Change•2014

  • Co-management and the co-production of knowledge

    Open Access•Derek Armitage, F Berkes et al.•Global Environmental Change•2011

  • Assessing the ‘usability’ of climate change research for decision-making

    Open Access•James D Ford, Maggie Knight et al.•Global Environmental Change•2013

  • Creating usable science

    Open Access•Lisa Dilling, Maria Carmen Lemos•Global Environmental Change•2010

  • The co-production of science and policy in integrated climate assessments

    Open Access•Maria Carmen Lemos, Barbara J Morehouse•Global Environmental Change•2005

  • Informed adaptation

    Open Access•Jacqueline Lacey, Mark Howden et al.•Global Environmental Change•2015

  • Rationality and Use of Information in Policy Decisions

    Open Access•Robert F Rich, Cheol H Oh et al.•Science Communication•2000

  • Countering the Loading-Dock Approach to Linking Science and Decision Making

    Open Access•David W Cash, Jonathan C Borck et al.•Science Technology & Human Values•2006

  • Seeking our shared wisdom

    Open Access•H Z Schuttenberg, Heidi Schuttenberg et al.•Conservation Ecology•2015

  • Coproductive capacities

    Open Access•Lorrae Van Kerkhoff, Lorrae E Van Kerkhoff et al.•Conservation Ecology•2015

  • Toward successful joint knowledge production for climate change adaptation

    Open Access•Dries Hegger, D L T Hegger et al.•Conservation Ecology•2014

  • Connecting knowledge with action through coproductive capacities

    Open Access•Carina Wyborn, Carina A Wyborn•Conservation Ecology•2015

  • Joint knowledge production for climate change adaptation

    Open Access•Dries Hegger, D L T Hegger et al.•Conservation Ecology•2015

  • Global change and conservation triage on National Wildlife Refuges

    Open Access•Fred A Johnson, Mitchell J Eaton et al.•Conservation Ecology•2015

  • The Strength of Weak Ties

    Mark Granovetter•Sociological Theory•1983

Unique citing works75
Citations per year9,38
Citation span2018 - 2026 (9)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 69

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae