Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Exploring the Space of Topic Coherence Measures

Bibliographic Data

ID23316993
AuthorsMichael Røder (0000-0002-8609-8277, Leipzig University), Andreas Both (0000-0002-9177-5463, R&D, Unister GmbH, Leipzig, Germany), Alexander Hinneburg (Martin Luther University Halle-Wittenberg)
Year2015
Pages399-408
Publication date2015-02-02
Peer ReviewedYes
Open AccessYes
TypeCONFERENCE
VenueProceedings of the Eighth ACM International Conference on Web Search and Data Mining (CONFERENCE)
PublisherACM (PUBLISHER)
DOI10.1145/2684822.2685324
OpenAlexW2038043464
LanguageEN
Citations received204
References cited12

Quantifying the coherence of a set of statements is a long standing problem with many potential applications that has attracted researchers from different sciences. The special case of measuring coherence of topics has been recently studied to remedy the problem that topic models give no guaranty on the interpretablity of their output. Several benchmark datasets were produced that record human judgements of the interpretability of topics. We are the first to propose a framework that allows to construct existing word based coherence measures as well as new ones by combining elementary components. We conduct a systematic search of the space of coherence measures using all publicly available topic relevance data for the evaluation. Our results show that new combinations of components outperform existing measures with respect to correlation to human ratings. nFinally, we outline how our results can be transferred to further applications in the context of text mining, information retrieval and the world wide web.

Coherence (philosophical gambling strategy) · Construct (python library) · Context (archaeology) · Data mining · Data science · Information retrieval · Interpretability · Natural language processing · Relevance (law) · Set (abstract data type) · Space (punctuation) · Advanced Text Analysis Techniques · Artificial Intelligence · Computer Science · Mathematics · Natural Language Processing Techniques · Topic Modeling

  • ChatGPT as an ecosystem shock

    Open Access•Hongyi Yang, Fangyuan Chang et al.•Technology in Society•2026

  • Diagnosing the status and trend of research on traditional knowledge related to non-timber forest products as food

    Open Access•Suyeon Min, Eunsoo Kim et al.•Trees Forests and People•2024

  • Public policies and vested interests preserve the animal farming status quo at the expense of animal product analogs

    Open Access•Simona Vallone, Eric F Lambin•One Earth•2023

  • Emoji and Religion in the Twitter Discourses on the Notre Dame Cathedral Fire

    Open Access•Frederik Elwert, Giulia Evolvi et al.•Journal of Religion Media and…•2023

  • Spreadshot

    Open Access•Carmela Bernardo, Marta Catillo et al.•Online Social Networks and Media•2025

  • Aihemallinnus hybridin mediatapahtuman ja merkitysten kierron tutkimuksessa

    Open Access•Pihla Toivanen, Jukka Huhtamäki et al.•Media & viestintä•2020

  • Text as big data

    Open Access•Finn Müller-Hansen, Max Callaghan et al.•Energy Research & Social Science•2020

  • BoycottMurree campaign on twitter

    Open Access•Adnan Muhammad Shah, Nadja Schweiggart•International Journal of Disaster…•2023

  • Deconstructing the organizational resilience of construction firms in major emergencies

    Open Access•Yuguo Zhang, Wenshun Wang et al.•International Journal of Disaster…•2024

  • Detecting information requirements for crisis communication from social media data

    Open Access•Qing Deng, Yang Gao et al.•International Journal of Disaster…•2020

  • Natural language processing-based characterization of top-down communication in smart cities for enhancing citizen alignment

    Open Access•Clément Nicolas, Jinwoo Kim et al.•Sustainable Cities and Society•2021

  • Age and Adaptation

    Open Access•Saeideh Heshmati, Jeff V Ramdass et al.•International Journal of…•2025

  • A decade of reflection and thematic review on artificial intelligence's impact on educational measurement

    Open Access•Jiawei Xiong, Feiming LI•Educational Research Review•2026

  • Not all refugees are framed equal

    Eduard Fabregat, Fernando Severino•International Journal of Media…•2024

  • Psychotherapist remarks’ ML classifier

    Open Access•Alexander Vanin, Vadim Bolshev et al.•Frontiers in Psychiatry•2025

  • Health Communication through Chinese Media on E-Cigarette

    Open Access•Qian Liu, Yu Liang et al.•International Journal of…•2022

  • Using machine learning techniques to investigate learner engagement with TikTok media literacy campaigns

    Christine Wusylko, Lauren Weisberg et al.•Journal of Research on Technology…•2024

  • Trianon és a holokauszt emlékezetpolitikai jellegzetességeinek elemzése természetesnyelv-feldolgozás használatával

    Open Access•Knap Árpád, Bartha Diána et al.•Szociológiai Szemle•2021

  • The value of student feedback in open forums

    Open Access•Carlos Valcarcel, Jeffrey Holmes et al.•Education Policy Analysis Archives•2021

  • Understanding host marketing strategies on Airbnb and their impact on listing performance

    Open Access•Yeojin Chung, Surendra Sarnikar•Information Technology and People•2022

  • Digital proctoring in higher education

    Open Access•Shengnan Han, Shahrokh Nikou et al.•International Journal of…•2024

  • How Cultural Environments Shape Online Sentiment Toward Social Movements

    Open Access•W J Scarborough, Allison Suppan Helmuth•Sociological Forum•2021

  • Mental health discourse and social media

    Open Access•Anna Pavlova, Alina Pavlova et al.•Social Science & Medicine•2020

  • Guided yet constrained

    Open Access•Yuan Wang, Yu Fu et al.•Tourism Management•2025

  • Topic-based engagement analysis

    Open Access•Inmaculada Rabadán-Martín, Lucía Barcos-Redín et al.•Tourism Management•2025

  • Tracking urban geo-topics based on dynamic topic model

    Open Access•Fang Yao, Yan Wang•Computers Environment and Urban…•2020

  • What we talk about when we talk about vegetarian diets

    Open Access•Zheng Chen, Jiahui Lin et al.•Appetite•2025

  • Data-driven decision-making in credit risk management

    Open Access•Jan Roeder, Matthias Palmer et al.•Decision Support Systems•2022

  • Approaches to improve preprocessing for Latent Dirichlet Allocation topic modeling

    Open Access•Jamie Zimmermann, Lance E Champagne et al.•Decision Support Systems•2024

  • A text-based monitoring tool for the legitimacy and guidance of technological innovation systems

    Open Access•Daniel Weiß, Fabian Nemeczek•Technology in Society•2021

  • Mining public sentiments and perspectives from geotagged social media data for appraising the post-earthquake recovery of tourism destinations

    Open Access•Yingwei Yan, Jingfu Chen et al.•Applied Geography•2020

  • A topic modelling analysis of white papers in security token offerings

    Open Access•Paola Bongini, Francesco Osborne et al.•Technological Forecasting and…•2022

  • Exploring blockchain-based innovations for economic and sustainable development in the global south

    Open Access•Moritz Böhmecke-Schwafert, Eduardo García Moreno•Technological Forecasting and…•2023

  • Yellin’ at Yellen

    James Bisbee, Nicolò Fraccaroli et al.•The Journal of Politics•2025

  • The primacy of taxonomic semantic organization over thematic semantic organization during picture naming

    Open Access•Mingjun Zhai, Chen Feng et al.•Cognition•2025

  • Dancing to the Partisan Beat

    Open Access•Juan Carlos Medina Serrano, Orestis Papakyriakopoulos et al.•12th ACM Conference on Web Science•2020

  • From marginality to mobilization

    Open Access•Pablo Moral, Manuel R Torres-Soriano•Journal of Information Technology…•2026

  • DarkOnto

    Open Access•Randa Basheer, Bassel Alkhatib et al.•Human Behavior and Emerging…•2024

  • Analysis of the Thematic Structure and Discursive Framing in Articles about Trianon and the Holocaust in the Online Hungarian Press Using LDA Topic Modelling

    Open Access•Ildikó Barna, Árpád Knap•Nationalities Papers•2023

  • Digital Cancer Communication Strategies in Spain

    Open Access•Diego Ravenda, Maika M Valencia-Silva et al.•Health & Social Care in the…•2026

  • Agenda-Setting in Cross-National Coverage of Covid-19

    Open Access•Kan Wu•Online Journal of Communication…•2021

  • Evidence map

    Open Access•Jiaqi Lu, Gregory F Nemet•Environmental Research Letters•2020

  • Communicating Europe

    Open Access•Roxane Rocca, Katharina Lawall et al.•Journal of Computational Social…•2024

  • Online mobilisation strategies

    Open Access•Elizaveta Kopacheva•Journal of Information Technology…•2023

  • Health as Battlefield

    Open Access•Qian Liu, Fan Yang•International Journal of…•2022

  • What Happens When People with Depression Gather Online

    Open Access•Xuening Wang, Xianyun Tian et al.•International Journal of…•2021

  • Consequences of recreational hunting for biodiversity conservation and livelihoods

    Open Access•Enrico Di Minin, Hayley S Clements et al.•One Earth•2021

  • Assessing linguistic bias in LLM outputs

    Open Access•Kavita Pabreja•Discover Education•2026

  • Policy events, emotional fluctuations, and vaccination behavior

    Open Access•Liang Li, Xiaoya Xu et al.•Frontiers in Public Health•2026

  • Mapping the Intellectual Landscape of Giftedness in Early Childhood Through Comparative Topic Modeling

    Open Access•Simge Karakaş Mısır•Journal of Intelligence•2026

  • Uncovering Ableism in Large Language Models’ Responses

    Open Access•Fitri Mutia, Alf Arira Ananta Aysya et al.•Social Sciences•2026

  • The Governance Paradox

    Open Access•Anis Ben Brik, Btool Hashim Alsayed•Public Organization Review•2026

  • Smarten

    Open Access•Jingyun Wang, J C Wang et al.•BMC Medical Education•2026

  • Two Hundred Eighty Characters of Environment

    Open Access•Ivan Russo, Federico Bertacchini et al.•Business Strategy and the…•2026

  • From Policy to Practice

    Open Access•Aidana Tleuken, Hamad Hassan Awan et al.•Business Strategy and the…•2026

  • Thematic Evolution of Educational Technology Research

    Open Access•Alper Aslan, Seda Aktı Aslan et al.•Journal of Educational Computing…•2026

  • Understanding content dissemination on sensemaking

    Open Access•Sushma Kumble, Pratiti Diddi et al.•Online Media and Global…•2025

  • Exploring incel discourse through topic modeling

    Open Access•Reyes Rodríguez, Aritz Gorostiza-Cerviño et al.•Humanities and Social Sciences…•2025

  • Leveraging social media data for pandemic detection and prediction

    Open Access•Boyang Shi, Weixiang Huang et al.•Humanities and Social Sciences…•2024

  • Phrase-level pairwise topic modeling to uncover helpful peer responses to online suicidal crises

    Open Access•Meng Jiang, Brooke A Ammerman et al.•Humanities and Social Sciences…•2020

  • A bibliometric study of research topics, collaboration, and centrality in the iterated prisoner’s dilemma

    Open Access•Nikoleta E Glynatsi, Vincent Knight et al.•Humanities and Social Sciences…•2021

  • Decoding Romanian labour protests

    Open Access•Ciprian Panzaru, Gabriela Negoiță•Humanities and Social Sciences…•2025

  • Mapping technological futures

    Open Access•Maciej Skórski, Alina Landowska et al.•Humanities and Social Sciences…•2025

  • The fate of bitumen

    Open Access•Sibo Chen•Humanities and Social Sciences…•2023

  • A practical evaluation of online self-assisted previewing architecture on rain classroom for biochemistry lab courses

    Open Access•Songbin Ben, Chenshu Liu et al.•Frontiers in Education•2024

  • What public health campaigns can learn from people’s Twitter reactions on mask-wearing and Covid-19 Vaccines

    Open Access•Yi Wang, Molu Shi et al.•Cogent Social Sciences•2021

  • Reclaiming waste narratives

    Open Access•Alejandra Balaguera, Manuela Escobar-Sierra et al.•Cogent Social Sciences•2026

  • A quantitative comparison of viral and hit songs in the Brazilian music market

    Open Access•Glaucimara Pires Oliveira, Ana Paula Couto Da Silva et al.•Revista Vórtex•2024

  • What media tells us about collaboration in disaster context

    Open Access•Soyoung Kim, Edgar Ramírez De La Cruz et al.•Frontiers in Communication•2026

  • Promoting Techno-Scientific Biomedical Communication in Russia

    Open Access•Alexander N Marchenko, Ilya Bykov•Frontiers in Communication•2022

  • Unfolding the policy dynamics of medical data assetization in Chinese public healthcare institutions

    Open Access•Su Han, Qihang Zeng et al.•Frontiers in Public Health•2026

  • Advancing universal health coverage through non-medical interventions

    Open Access•Zheng Wang, Zhihua Wang et al.•Frontiers in Public Health•2026

  • A Systematic Review of Generative AI for Teaching and Learning Practice

    Open Access•Bayode Ogunleye, Kudirat Ibilola Zakariyyah et al.•Education Sciences•2024

  • AllforJan

    Open Access•Tamas Kovacs, Anna Kovacs-Györi et al.•ISPRS International Journal of…•2021

  • An integrated LDA and SciBert Model for Topic Analysis

    Open Access•Jianping Wang, Mingtao Lu et al.•SAGE Open•2026

  • Balancing Authority and Accessibility

    Open Access•Yang Yang, Shuang Wang et al.•SAGE Open•2025

  • Commenting on Brand Posts during a Crisis

    Yang Feng, Linwan Wu•Journal of Interactive Advertising•2021

  • What Makes Disinformation Ads Engaging? A Case Study of Facebook Ads from the Russian Active Measures Campaign

    Mirela Silva, Luiz Giovanini et al.•Journal of Interactive Advertising•2023

  • Evolving Consumer Responses to Social Issue Campaigns

    Yang Feng, Huan Chen•Journal of Interactive Advertising•2022

  • Topic modelling for wildlife tourism online reviews

    Ziye Shang, J M Luo•Current Issues in Tourism•2023

  • Unravelling long-stay tourist experiences and satisfaction

    Seong-Su Kim, Woosik Shin et al.•Current Issues in Tourism•2025

  • Unfolding cognitive themes and emotion dynamics in the ‘metaverse and tourism’

    Zhen Su, Chunmu Wang et al.•Current Issues in Tourism•2025

  • Herd behavior influence on decision-making during evacuation process

    Open Access•Minrui Ni, Manting Ni et al.•Current Psychology•2024

  • Mental effort matters

    Open Access•Min Liu, Songhee Han et al.•Educational Technology Research…•2025

  • Fitspiration on Instagram

    Volha Murashka, Jiaying Liu et al.•Health Communication•2021

  • Promoting Teen Pregnancy Prevention

    Erin Ash, Emma Cox et al.•Health Communication•2026

  • Cross-generational analysis of residential place attachment to a Chinese rural destination

    Zhe Chen, Chris Ryan et al.•Journal of Sustainable Tourism•2022

  • Tourism development in the context of ecological transformation

    Open Access•Xiafei Li, Tarik Dogru et al.•Journal of Sustainable Tourism•2026

  • Investigating evidence-oriented generation of synthetic text data with a generative large language model in science education

    Open Access•Judith Stanja, Sarah Dannemann et al.•International Journal of Science…•2025

  • Science and engineering for what? A large-scale analysis of theme selection in K-12 science and engineering fair projects

    Open Access•Adelmo Eloy, Thomas Palmeira Ferraz et al.•International Journal of Science…•2026

  • AI as “Artificial Immigrants”? A Content Analysis of the U.S. News Media Framing of AI Threats

    Open Access•Yingqi Pan, Stephanie Herrera et al.•Journal of Broadcasting &…•2026

  • “Spreader of conspiracies”

    Open Access•Arif Md Tareque Habib, Mohammad Yousuf et al.•Newspaper Research Journal•2023

  • Clicks, comments, and concerns

    Binshad Vaheed, Sangeeta Sahney•Loisir et Société / Society and…•2026

  • Machine and expert judgments of student perceptions of teaching behavior in secondary education

    Open Access•Bilge Gençoglu, Michelle Helms‐lorenz et al.•Computers & Education•2023

  • From curriculum to strategy

    Hongwon Jeong•Asia Pacific Journal of Education•2025

  • Investigating sense of place of the Las Vegas Strip using online reviews and machine learning approaches

    Open Access•Yang Song, Runzi Wang et al.•Landscape and Urban Planning•2021

  • Online Signals of Extremist Mobilization

    Open Access•Oli Brown, Laura G E Smith et al.•Personality and Social Psychology…•2026

  • Determining the causes of user frustration in the case of conversational chatbots

    Sakhhi Chhabra, Vaishali Kaushal et al.•Behaviour and Information…•2025

  • Is this real life? – Exploring leadership communication on Twitter/X

    Open Access•Christina Strauss, Michael Dominic Harr et al.•Behaviour and Information…•2026

  • Low-Code excellence

    Alicja Techmanska, Christoph Stöckmann•Behaviour and Information…•2026

  • What Is the Problem of Coherence and Truth?

    Erik J Olsson•The Journal of Philosophy•2002

  • Measuring coherence

    Open Access•Igor Douven, Wouter Meijs•Synthese•2007

Unique citing works204
Citations per year22,67
Citation span2017 - 2026 (10)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 169

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae