Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Improving Probabilistic Models In Text Classification Via Active Learning

Bibliographic Data

ID3273399
AuthorsMitchell Bosley (0000-0002-9172-966X, University of Toronto, corresponding author), Saki Kuzushima (0000-0003-3014-5203, Harvard University, corresponding author), Ted Enamorado (0000-0002-2022-7646, Washington University in St. Louis, corresponding author), Yuki Shiraito (0000-0003-0264-1138, Michigan United, corresponding author)
Year2025
Volume119
Issue2
Pages985-1002
Publication date2025-05-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueAmerican Political Science Review (JOURNAL)
Journal identifiersISSN: 0003-0554 • E-ISSN: 1537-5943
PublisherCambridge University Press (CUP) (PUBLISHER)
DOI10.1017/s0003055424000716
OpenAlexW4401340787
LanguageEN
Citations received3
References cited36

Social scientists often classify text documents to use the resulting labels as an outcome or a predictor in empirical research. Automated text classification has become a standard tool since it requires less human coding. However, scholars still need many human-labeled documents for training. To reduce labeling costs, we propose a new algorithm for text classification that combines a probabilistic model with active learning. The probabilistic model uses both labeled and unlabeled data, and active learning concentrates labeling efforts on difficult documents to classify. Our validation study shows that with few labeled data, the classification performance of our algorithm is comparable to state-of-the-art methods at a fraction of the computational cost. We replicate the results of two published articles with only a small fraction of the original labeled data used in those studies and provide open-source software to implement our method

Active learning (machine learning · Machine learning · Probabilistic logic · Advanced Text Analysis Techniques · Artificial Intelligence · Computer Science · Machine Learning and Data Classification · Topic Modeling

  • High accuracy with low costs

    Open Access•Cecilia Y Sui•Political Science Research and…•2026

  • When Trade Engagement Escalates Hostility

    Open Access•Chuanzheng Zhang, Chitao Yu•Journal of Chinese Political…•2026

  • Probabilistic Record Linkage Using Pretrained Text Embeddings

    Open Access•Joseph T Ornstein•Political Analysis•2025

  • Making the News

    Amber E Boydstun•Making the News•2013

  • Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead

    Open Access•Cynthia Rudin•Nature Machine Intelligence•2019

  • A Survey of Methods for Explaining Black Box Models

    Open Access•Riccardo Guidotti, Anna Monreale et al.•ACM Computing Surveys•2019

  • Energy and Policy Considerations for Deep Learning in NLP

    Open Access•Emma Strubell, Ananya Ganesh et al.•Proceedings of the 57th Annual…•2019

  • Finite Mixture Models

    Open Access•Geoffrey J McLachlan, Geoffrey McLachlan et al.•Finite Mixture Models (Wiley…•2000

  • Maximum Likelihood from Incomplete Data Via the EM Algorithm

    Open Access•A P Dempster, N M Laird et al.•Journal of the Royal Statistical…•1977

  • Echo Chamber or Public Sphere? Predicting Political Orientation and Measuring Political Homophily in Twitter Using Big Data

    Open Access•Elanor Colleoni, Alessandro Rozza et al.•Journal of Communication•2014

  • Deadly Clerics

    Richard A Nielsen•Deadly Clerics•2017

  • Electoral Reform and National Security in Japan

    Open Access•Amy Catalinac•Electoral Reform and National…•2016

  • Computer-Assisted Topic Classification for Mixed-Methods Social Science Research

    Dustin Hillard, Stephen Purpura et al.•Journal of Information Technology…•2008

  • Active Learning Approaches for Labeling Text

    Open Access•Blake Miller, Fridolin Linder et al.•Political Analysis•2020

  • Use of force and civil–military relations in Russia

    Brandon M Stewart, Brandon Stewart et al.•Small Wars and Insurgencies•2009

  • Machine Learning Predictions as Regression Covariates

    Open Access•Celeste Fong, Christian Fong et al.•Political Analysis•2021

  • Estimating Spatial Preferences from Votes and Text

    Open Access•In Song Kim, John Londregan et al.•Political Analysis•2018

  • Classification Accuracy as a Substantive Quantity of Interest

    Open Access•Andrew Peterson, Andrew F Peterson et al.•Political Analysis•2018

  • Machine Learning Human Rights and Wrongs

    Open Access•Kevin Greene, Kevin T Greene et al.•Political Analysis•2019

  • Disaggregating Repression

    Open Access•Rebecca Cordell, K Chad Clay et al.•International Studies Quarterly•2022

  • Testing Causal Theories with Learned Proxies

    Open Access•David Knox, Dean Knox et al.•Annual Review of Political Science•2022

  • Repression Technology

    Open Access•Anita R Gohdes, Anita Gohdes•American Journal of Political…•2020

  • Keyword‐Assisted Topic Models

    Open Access•Shusei Eshima, Katsushi Imai et al.•American Journal of Political…•2024

  • Whose Ideas? Whose Words? Authorship of Ronald Reagan's Radio Addresses

    Open Access•Edoardo M Airoldi, Stephen E Fienberg et al.•PS Political Science & Politics•2007

  • Text as Data

    Open Access•Kendralin J Freeman, Kendralin Freeman•Contemporary Sociology A Journal…•2023

  • Electoral Accountability and Particularistic Legislation

    Open Access•Lucia Motolinia•American Political Science Review•2021

  • Human Rights are (Increasingly) Plural

    Open Access•Baekkwan Park, Kevin Greene et al.•American Political Science Review•2020

  • Who Polices the Administrative State

    Open Access•Kenneth Lowande•American Political Science Review•2018

  • How the Chinese Government Fabricates Social Media Posts for Strategic Distraction, Not Engaged Argument

    Open Access•Gary King, Jennifer Pan et al.•American Political Science Review•2017

Unique citing works3
Citations per year3
Citation span2025 - 2026 (2)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 2

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae