Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations
Bibliographic Data
| ID | 23324745 |
|---|---|
| Authors | D N Moriasi D N Moriasi, Daniel N Moriasi (0000-0002-3389-3277, United States Department of Agriculture), J G Arnold J G Arnold, J G Arnold (United States Department of Agriculture), M W Van Liew M W Van Liew, M W Van Liew (Montana State University), Ronald L Bingner (United States Department of Agriculture), R L Bingner R L Bingner, R D Harmel (0000-0002-5344-1286, United States Department of Agriculture), R D Harmel R D Harmel, Tamie L Veith (0000-0001-7631-0214), T L Veith T L Veith |
| Year | 2007 |
| Volume | 50 |
| Issue | 3 |
| Pages | 885-900 |
| Publication date | 2007-01-01 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Transactions of the ASABE (JOURNAL) |
| Journal identifiers | ISSN: 2151-0032 • E-ISSN: 2151-0040 |
| Publisher | American Society of Agricultural and Biological Engineers (ASABE) (PUBLISHER) |
| DOI | 10.13031/2013.23153 |
| OpenAlex | W2058998445 |
| Language | EN |
| Citations received | 146 |
| References cited | 1 |
Watershed models are powerful tools for simulating the effect of watershed processes and management on soil and water resources. However, no comprehensive guidance is available to facilitate model evaluation in terms of the accuracy of simulated data compared to measured flow and constituent values. Thus, the objectives of this research were to: (1) determine recommended model evaluation techniques (statistical and graphical), (2) review reported ranges of values and corresponding performance ratings for the recommended statistics, and (3) establish guidelines for model evaluation based on the review results and project-specific considerations; all of these objectives focus on simulation of streamflow and transport of sediment and nutrients. These objectives were achieved with a thorough review of relevant literature on model application and recommended model evaluation methods. Based on this analysis, we recommend that three quantitative statistics, Nash-Sutcliffe efficiency (NSE), percent bias (PBIAS), and ratio of the root mean square error to the standard deviation of measured data (RSR), in addition to the graphical techniques, be used in model evaluation. The following model evaluation performance ratings were established for each recommended statistic. In general, model simulation can be judged as satisfactory if NSE > 0.50 and RSR < 0.70, and if PBIAS + 25% for streamflow, PBIAS + 55% for sediment, and PBIAS + 70% for N and P. For PBIAS, constituent-specific performance ratings were determined based on uncertainty of measured data. Additional considerations related to model evaluation guidelines are also discussed. These considerations include: single-event simulation, quality and quantity of measured data, model calibration procedure, evaluation time step, and project scope and magnitude. A case study illustrating the application of the model evaluation guidelines is also provided.
Calibration · Data mining · Hydrology (agriculture) · Machine learning · Standard deviation · Statistic · Statistics · Streamflow · Watershed · Computer Science · Environmental Science · Geology · Groundwater flow and contamination studies · Hydrology and Watershed Management Studies · Mathematics · Soil and Water Nutrient Dynamics
Minimizing uncertainties in climate projections and water budget reveals the vulnerability of freshwater to climate change
Hydrological response to land use/land cover projection in Cisadane watershed, Indonesia
Erosion Risk Assessment for Prioritization of Conservation Measures in the Watershed of Genale Dawa-3 Hydropower Dam, Ethiopia
Regionalizacion de caudales mensuales en la región hidrográfica del Titicaca Puno Perú
Development of an empirical flood fragility curve for levee failure and its application in probabilistic flood risk assessment
Integrating seasonal forecasts into real-time drought management
Integrated evaluation of flood mitigation measures
Risk assessment of river bank failure due to floods in Jamuna, Ganges and Padma Rivers in Bangladesh
Exploring trade-offs between SDGs for Indus River Dolphin conservation and human water security in the regulated Beas River, India
Integrating Landscape Metrics and Hydrologic Modeling to Assess the Impact of Natural Disturbances on Ecohydrological Processes in the Chenyulan Watershed, Taiwan
Comprehensive Performance Evaluation for Hydrological and Nutrients Simulation Using the Hydrological Simulation Program–Fortran in a Mesoscale Monsoon Watershed, China
Development of a Hydrologic and Water Allocation Model to Assess Water Availability in the Sabor River Basin (Portugal)
Assessment of Runoff and Sediment Yields Using the AnnAGNPS Model in a Three-Gorge Watershed of China
Variations in the Distribution of Chl-a and Simulation Using a Multiple Regression Model
The Role of Mangroves in the Retention of Heavy Metal (Chromium)
Comparison of Missing Data Infilling Mechanisms for Recovering a Real-World Single Station Streamflow Observation
Modeling of the Mendoza river watershed as a tool to study climate change impacts on water availability
Increased seasonal rainfall in the twenty-first century over Ghana and its potential implications for agriculture productivity
Ecological and economic impacts of different irrigation and fertilization practices
Temporal and spatial characteristics of drought, future changes and possible drivers over Upper Awash Basin, Ethiopia, using SPI and SPEI
Fostering integrated land and water management approaches
Establishing an early warning system for flash floods in Hoang Su Phi District, Ha Giang Province, Vietnam
The phylogenetic legacy of Freud's totem protoGod
Integrated Water Resources Management: A Systems Perspective of Water Governance and Hydrological Conditions
Sensors track mobilization of ‘chemical cocktails’ in streams impacted by road salts in the Chesapeake Bay watershed
Dealing with uncertainty in water scarcity footprints
Leveraging synthetic assimilation of remote sensing with the National Water Model (NWM) to improve above-normal flow prediction in ungauged basins
Green roof seasonal variation
A hybrid model for river water temperature as a function of air temperature and discharge
Cooling hot cities
Efficiency and sustainability of land-resource use on a small island
Projecting the land cover change and its environmental impacts in the Cedar River Basin in the Midwestern United States
Spatiotemporal variations and its driving factors of ground surface temperature in China
Potential effects of possible climate change on sea surface temperatures
Nutrient retention in European lakes and rivers
Modelling plastic fluxes with Inca-macroplastics in the Imus catchment
Modification of exploration of long‐term nutrient trajectories for nitrogen (ElemeNT-N) model to quantify legacy nitrogen dynamics in a typical watershed of eastern China
On the role of climate change in the 2018 flooding event in Kerala
Can blue–green infrastructure counteract the effects of climate change on combined sewer overflows? Study of a swiss catchment
Stand characteristics regulate forest water use efficiency in the Three-North Shelterbelt Forest Program region of China
Years of California’s water rights system
Reconstructing groundwater and lake level histories in Northern Wisconsin
Implementation of BMP Strategies for Adaptation to Climate Change and Land Use Change in a Pasture-Dominated Watershed
SWAT Modeling of Non-Point Source Pollution in Depression-Dominated Basins under Varying Hydroclimatic Conditions
Effectiveness Analysis of Systematic Combined Sewer Overflow Control Schemes in the Sponge City Pilot Area of Beijing
Spatial Distribution and Health Risk Assessment of Potentially Toxic Elements in Surface Soils of Bosten Lake Basin, Central Asia
Effects of Landscape Pattern Change on Water Yield and Nonpoint Source Pollution in the Hun-Taizi River Watershed, China
Adapting the Wepp Hillslope Model and the TLS Technology to Predict Unpaved Road Soil Erosion
Evidence-Based Integrated Analysis of Environmental Hazards in Southern Bolivia
New Framework for Dynamic Water Environmental Capacity Estimation Integrating the Hydro-Environmental Model and Load–Duration Curve Method—A Case Study in Data-Scarce Luanhe River Basin
Evaluating the Relationships between Riparian Land Cover Characteristics and Biological Integrity of Streams Using Random Forest Algorithms
Potential to Reduce Chemical Fertilizer Application in Tea Plantations at Various Spatial Scales
Economic Estimation of the Losses Caused by Surface Water Pollution Accidents in China From the Perspective of Water Bodies’ Functions
Response Model for Urban Area Source Pollution and Water Environmental Quality in a River Network Region
Data-Driven Modeling and the Influence of Objective Function Selection on Model Performance in Limited Data Regions
Assessment of the Spatial and Temporal Variations of Water Quality for Agricultural Lands with Crop Rotation in China by Using a Hype Model
Issues and Challenges in the Application of the Ieubk Model in the Health Risk Assessment of Lead
Evaluation of Drought Implications on Ecosystem Services
Insights into the Pollutant Removal Performance of Stormwater Green Infrastructures
Non-Point Source Pollution Simulation and Best Management Practices Analysis Based on Control Units in Northern China
Just water reallocation for the environment and agriculture
Influence of intrinsic and extrinsic motivation on higher education performance
The combined effects of Lulc changes and climate change on hydrological processes of Gilgel Gibe catchment, southwest Ethiopia
Daily Water Level Prediction of Zrebar Lake (Iran)
Integration of Geostatistical and Sentinal-2AMultispectral Satellite Image Analysis for Predicting Soil Fertility Condition in Drylands
Improved Estimations of Nitrate and Sediment Concentrations Based on SWAT Simulations and Annual Updated Land Cover Products from a Deep Learning Classification Algorithm
Early Flood Monitoring and Forecasting System Using a Hybrid Machine Learning-Based Approach
Investigating Relationships between Runoff–Erosion Processes and Land Use and Land Cover Using Remote Sensing Multiple Gridded Datasets
Integrating Field Measurements for Event-Based Flood Modeling
Developing flood vulnerability curve for rice crop using remote sensing and hydrodynamic modeling
Evaluating the urban flood risk mitigation and cost-effectiveness of green roofs
An interactive Web-GIS fluvial flood forecast and alert system in operation in Portugal
Proof-of-concept evaluation at Cox’s Bazar of the Safe Water Optimization Tool
Modeling the impacts of land use and land cover changes on streamflow and sediment yield with the SWAT Model in Migori River Watershed, Lake Victoria Basin Region, Kenya
Modelling the impact of land use/cover changes on water balance of a humid equatorial highland catchment in Southwestern Uganda, East Africa
Flood investigation and adaptation strategies through best management practices in an ungauged basin in Southwest Nigeria
Intensity analysis applied to land use and land cover change and transitions in a fragile tropical mountain environment
South Asian agriculture increasingly dependent on meltwater and groundwater
Assessing the Impacts of Land Use, Land Cover, and Climate Change on the Hydrological Regime of a Humid Tropical Basin
Unveiling the characteristics of water conservation variations in peatland watershed under climate change with an enhanced SWAT model
Evaluating two GIS-based semi-distributed hydrological models in the Bhagirathi-Alkhnanda River catchment in India
Impact of the Water Reservoir and River Engineering Structures on Longitudinal and Transverse (Dis)connectivity Associated With Sediment Transfer
Developing SWAT‐S to strengthen the soil erosion forecasting performance of the SWAT model
Attribution analysis of climatic and multiple anthropogenic causes of runoff change in the Loess Plateau—A case‐study of the Jing River Basin
Evaluation of the impact of the Gully Land Consolidation Project on runoff under extreme rainfall
Parameter Estimation to Process Optimization
Prioritization of critical source areas for soil and water conservation by using a one‐at‐a‐time removal approach in the upper Huaihe River basin
New physiological thresholds improve soil desiccation prediction rationality in apple orchards converted from farmland on the Chinese Loess Plateau
Effects of Repeated Low‐Severity Fires on Particle Detachment Capacity and Soil Properties in Rills of Semi‐Arid Forests
Increasing urban flood risk in China over recent 40 years induced by Lucc
Predicting context-sensitive urban green space quality to support urban green infrastructure planning
How global warming alters future maize yield and water use efficiency in China
Spatiotemporal Analysis of the Hydrological Responses to Land-Use Land-Cover Changes in the Manafwa Catchment, Eastern Uganda
Development of reservoir’s optimum operation rules considering water quality issues and climatic change data analysis
A tight coupling model for urban flood simulation based on SWMM and Telemac-2D and the uncertainty analysis
Exploring the hydrological impact of increasing urbanisation on a tropical river catchment of the metropolitan Jakarta, Indonesia
Participatory Framework for Urban Pluvial Flood Modeling in the Digital Twin Era
Improve leakage management to reach sustainable water supply networks through by green energy systems. Optimized case study
Urban form and climate interplay
Is it possible to develop a green management strategy applied to water systems in isolated cities? An optimized case study in the Bahamas
| Unique citing works | 146 |
|---|---|
| Citations per year | 10,43 |
| Citation span | 2012 - 2026 (15) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 123 |