Best Practices for Applying and Interpreting the Total Operating Characteristic
Bibliographic Data
| ID | 22032651 |
|---|---|
| Authors | Tanner Honnef (0009-0004-7338-7012, Clark University), Robert Gilmore Pontius (0000-0001-7287-5875, Clark University, corresponding author) |
| Year | 2025 |
| Volume | 14 |
| Issue | 4 |
| Pages | 134 |
| Publication date | 2025-03-23 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | ISPRS International Journal of Geo-Information (JOURNAL) |
| Journal identifiers | ISSN: 2220-9964 • E-ISSN: 2220-9964 |
| Publisher | MDPI AG (PUBLISHER • IT) |
| DOI | 10.3390/ijgi14040134 |
| OpenAlex | W4408773515 |
| Language | EN |
| References cited | 39 |
The Total Operating Characteristic (TOC) is an improvement on the quantitative method called the Relative Operating Characteristic (ROC), both of which plot the association between a binary variable and a rank variable. TOC curves reveal the sizes of the four entries in the confusion matrix at each threshold, which make TOC curves more easily interpretable than ROC curves. The TOC has become popular, especially to assess the fit of simulation models to predict land change. However, the literature has shown variation in how authors apply and interpret the TOC, creating some misleading conclusions. Our manuscript lists best practices when applying and interpreting the TOC to help scientists learn from TOC curves. An example illustrates these practices by applying the TOC to measure the ability to predict the gain of crop in Western Bahia, Brazil. The application compares four ways to design the rank variable based on the distance to either pixels or patches of either the presence or change of crop. The results show that the gain of crop during the validation time interval is more strongly associated with the distance to patches rather than pixels of crop. The Discussion Section reveals that if authors show the TOC curves, then readers can interpret the results in ways that the authors might have missed. The Conclusion encourages scientists to follow best practices to learn the wealth of information that the TOC reveals
Measuring the Accuracy of Diagnostic Systems
A future land use simulation model (FLUS) for simulating multiple land use scenarios by coupling human and natural effects
The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets
Reconstructing Three Decades of Land Use and Land Cover Changes in Brazilian Biomes with Landsat Archive and Earth Engine
Integrating a Forward Feature Selection algorithm, Random Forest, and Cellular Automata to extrapolate urban growth in the Tehran-Karaj Region of Iran
Spatiotemporal patterns of urban land use change in the rapidly growing city of Lusaka, Zambia
Intensity Characteristics and Multi-Scenario Projection of Land Use and Land Cover Change in Hengyang, China
Harnessing the indirect effect of urban expansion for mitigating agriculture-environment trade-offs in the Loess Plateau
| Highly cited | No |
|---|