Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Interactive machine teaching

A human-centered approach to building machine-learned models

Bibliographic Data

ID15215980
AuthorsGonzalo Ramos (0000-0003-4198-5021, Microsoft Research, Redmond, WA, USA, corresponding author), Christopher Meek (0000-0003-1696-6152, Microsoft Research, Redmond, WA, USA), Patrice Simard (Microsoft), Jina Suh (0000-0002-7646-5563, Microsoft Research, Redmond, WA, USA), Soroush Ghorashi (Microsoft)
Year2020
Volume35
Issue5-6
Pages413-451
Publication date2020-04-30
Open AccessNo
TypeARTICLE
VenueHuman-Computer Interaction (JOURNAL)
Journal identifiersISSN: 0737-0024 • E-ISSN: 1532-7051
PublisherTaylor & Francis (PUBLISHER • GB)
DOI10.1080/07370024.2020.1734931
OpenAlexW3023626240
LanguageEN
Citations received6
References cited47

Modern systems can augment people’s capabilities by using machine-learned models to surface intelligent behaviors. Unfortunately, building these models remains challenging and beyond the reach of non-machine learning experts. We describe interactive machine teaching (IMT) and its potential to simplify the creation of machine-learned models. One of the key characteristics of IMT is its iterative process in which the human-in-the-loop takes the role of a teacher teaching a machine how to perform a task. We explore alternative learning theories as potential theoretical foundations for IMT, the intrinsic human capabilities related to teaching, and how IMT systems might leverage them. We argue that IMT processes that enable people to leverage these capabilities have a variety of benefits, including making machine learning methods accessible to subject-matter experts and the creation of semantic and debuggable machine learning (ML) models. We present an integrated teaching environment (ITE) that embodies principles from IMT, and use it as a design probe to observe how non-ML experts do IMT and as the basis of a system that helps us study how to guide teachers. We explore and highlight the benefits and challenges of IMT systems. We conclude by outlining six research challenges to advance the field of IMT

Expert system · Field (mathematics · Human–computer interaction · Human–machine system · Leverage (statistics · Machine learning · Process (computing · Subject-matter expert · Computer Science · Data Visualization and Analytics · Ethics and Social Impacts of AI · Explainable Artificial Intelligence (XAI · Artificial Intelligence

  • Human-in-the-loop machine learning

    Open Access•Eduardo Mosqueira-Rey, Elena Hernández-Pereira et al.•Artificial Intelligence Review•2023

  • Learning Management Systems as Anti-Convivial Tools

    Open Access•Edward M Maclin, Edward Maclin•Fast Capitalism•2022

  • “What are they not telling me?” Learning machine learning

    Open Access•Robert Cinca, Enrico Costanza et al.•International Journal of…•2025

  • From explainable to interactive AI

    Open Access•Muhammad Raees, Inge Meijerink et al.•International Journal of…•2024

  • Integrating Robotics in Art Education

    Open Access•Shujun Dong, Ran Zhi et al.•European Journal of Education•2025

  • Understanding the impact and design of AI teammate etiquette

    Christopher Flathmann, Nathan J McNeese et al.•Human-Computer Interaction•2023

  • Reinforcement Learning

    Open Access•Richard S Sutton, A G Barto et al.•IEEE Transactions on Neural…•1998

  • Scratch

    Open Access•Mitchel Resnick, John Maloney et al.•Communications of the ACM•2009

  • European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”

    Open Access•Bryce Goodman, Seymour Flaxman et al.•AI Magazine•2017

  • Explaining Explanations in AI

    Open Access•Brent Mittelstadt, Chris Russell et al.•Proceedings of the Conference on…•2019

  • Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead

    Open Access•Cynthia Rudin•Nature Machine Intelligence•2019

  • The Mythos of Model Interpretability

    Open Access•Zachary C Lipton•Queue•2018

Citations per year1.5
Citation span2022 - 2025 (4)
Highly citedNo

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae