Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Automated Visual Content Analysis (Avca) in Communication Research

A Protocol for Large Scale Image Classification with Pre-Trained Computer Vision Models

Bibliographic Data

ID12971129
AuthorsTheo Araujo (0000-0002-4633-9339, University of Amsterdam, corresponding author), Irina Lock (0000-0002-0524-3330, University of Amsterdam), Bob van de Velde (University of Amsterdam)
Year2020
Volume14
Issue4
Pages239-265
Publication date2020-09-02
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueCommunication Methods and Measures (JOURNAL)
Journal identifiersISSN: 1931-2458 • E-ISSN: 1931-2466
PublisherTaylor & Francis (PUBLISHER • GB)
DOI10.1080/19312458.2020.1810648
OpenAlexW3082875060
LanguageEN
Citations received17
References cited84

The increasing volume of images published online in a wide variety of contexts requires communication researchers to address this reality by analyzing visual content at a large scale. Ongoing advances in computer vision to automatically detect objects, concepts, and features in images provide a promising opportunity for communication research. We propose a research protocol for Automated Visual Content Analysis (AVCA) to enable large-scale content analysis of images. It offers inductive and deductive ways to use commercial pre-trained models for theory building in communication science. Using the example of corporations’ website images on sustainability, we show in a step-by-step fashion how to classify a large sample (N = 21,876) of images with unsupervised and supervised machine learning, as well as custom models. The possibilities and pitfalls of these approaches are discussed, ethical issues are addressed, and application examples for future communication research are detailed

Communications protocol · Data science · Human–computer interaction · Machine learning · Multimedia · Protocol (science · Sample (material · Scale (ratio · Variety (cybernetics · Visual Communication · Computational and Text Analysis Methods · Computer Science · Law in Society and Culture · Public Relations and Crisis Communication · Artificial Intelligence

  • Visual storytelling through the void

    Open Access•Yao Song, Weilin Li et al.•Humanities and Social Sciences…•2025

  • Promises and pitfalls of using computer vision to make inferences about landscape preferences

    Open Access•Emily Wilkins, Emily J Wilkins et al.•Landscape and Urban Planning•2022

  • Computer Vision Models for Image Analysis in Advertising Research

    Open Access•Hairong Li, Nan Zhang•Journal of Advertising•2024

  • Integrating Network Clustering Analysis and Computational Methods to Understand Communication With and About Brands

    Itai Himelboim, Ewa Maslowska et al.•Journal of Advertising•2024

  • Seeing Formalism or Formal Viewing

    Open Access•Lauren Tilton, Justin Wigard•Journal of Cultural Analytics•2025

  • Who is Imaged as Being Related to Climate Change? Localization and Individualization of Human Visual Images in China Search Engine

    Jing Su, Yunsong Li et al.•Environmental Communication•2026

  • Worlds of Agents

    Open Access•Annie Waldherr, M Hilbert et al.•Communication Methods and Measures•2021

  • International media coverage of the 2023 Gaza War

    Open Access•Kareem El Damanhoury, Ayse Lokmanoglu et al.•Media War & Conflict•2026

  • Promises and Pitfalls of Social Media Data Donations

    Open Access•Irene I Van Driel, Anastasia Giachanou et al.•Communication Methods and Measures•2022

  • Topic modeling of video and image data

    Ayse D Lokmanoglu, Dror Walter•Communication Methods and Measures•2025

  • Image networks and practice analysis of larger data corpora. An approach to cluster and recontextualize visual practice in social media

    Open Access•Wolfgang Reißmann, Miriam Siemon et al.•Studies in Communication Sciences•2023

  • Images, clusters and types – Making sense of (large) image corpora and related practices in and with digital media

    Open Access•Wolfgang Reißmann, Ulla Autenrieth et al.•Studies in Communication Sciences•2024

  • Indonesia–Malaysia relations from below

    Ali Maksum•South East Asia Research•2022

  • Automated Visual Analysis for the Study of Social Media Effects

    Yilang Peng, Irina Lock et al.•Communication Methods and Measures•2023

  • Biophilia gratification

    Open Access•Y L Ng, Zhihuai Lin•New Media & Society•2026

  • Face Detection, Tracking, and Classification from Large-Scale News Archives for Analysis of Key Political Figures

    Open Access•Andreu Girbau, T Kobayashi et al.•Political Analysis•2024

  • Seeing the Black Lives Matter Movement Through Computer Vision? An Automated Visual Analysis of News Media Images on Facebook

    Open Access•Minchul Kim, Ozen Bas•Social Media + Society•2023

  • The general inquirer

    Philip J Stone•The general inquirer•1966

  • Analyzing Media Messages

    Daniel Riff, Frederick Fico et al.•Analyzing Media Messages•2014

  • AI can be sexist and racist — it’s time to make it fair

    Open Access•James Zou, L Schiebinger•Nature•2018

  • Machine learning

    Open Access•M I Jordan, T M Mitchell•Science•2015

  • A Content Analysis of the Content Analysis Literature in Organization Studies

    Open Access•Vincent J Duriau, Rhonda K Reger et al.•Organizational Research Methods•2007

  • ImageNet

    Jia Deng, Wei Dong et al.•2009 IEEE Conference on Computer…•2009

  • The Visual Image and the Political Image

    Dan Schill•Review of Communication•2012

  • Topic Modeling as a Strategy of Inquiry in Organizational Research

    Open Access•Theresa Schmiedel, Oliver Müller et al.•Organizational Research Methods•2019

  • The Ethics of Big Data

    Open Access•Brent Mittelstadt, Luciano Floridi•Science and Engineering Ethics•2016

  • Taking Stock of the Toolkit

    Jelle W Boumans, Damian Trilling•Digital Journalism•2016

  • ImageNet classification with deep convolutional neural networks

    Open Access•Alex Krizhevsky, Ilya Sutskever et al.•Communications of the ACM•2017

  • Quantitative analysis of large amounts of journalistic texts using topic modelling

    Carina Jacobi, Wouter Van Atteveldt et al.•Digital Journalism•2016

  • ImageNet Large Scale Visual Recognition Challenge

    Open Access•Olga Russakovsky, Jia Deng et al.•International Journal of Computer…•2015

  • The Use of Twitter to Track Levels of Disease Activity and Public Concern in the U.S. during the Influenza A H1N1 Pandemic

    Open Access•Alessio Signorini, Alberto M Segre et al.•PLoS ONE•2011

  • Social Data

    Open Access•Alexandra Olteanu, Carlos Castillo et al.•Frontiers in Big Data•2019

  • Exploring the Space of Topic Coherence Measures

    Open Access•Michael Røder, Andreas Both et al.•Proceedings of the Eighth ACM…•2015

  • Same Candidates, Different Faces

    Open Access•Yilang Peng•Journal of Communication•2018

  • Image Themes and Frames in US Print News Stories about Climate Change

    Stacy Rebich-Hespanha, R E Rice et al.•Environmental Communication•2015

  • Overcoming terms of service

    Alexander Halavais•Information Communication & Society•2019

  • Taking Television Seriously

    Open Access•Erik P Bucy, Maria Elizabeth Grabe•Journal of Communication•2007

  • A Clearer Picture

    Open Access•Thomas E Powell, Hajo G Boomgaarden et al.•Journal of Communication•2015

  • Understanding Consumer Conversations Around Ads in a Web 2.0 World

    Camille Campbell, Colin Campbell et al.•Journal of Advertising•2011

  • Computer-Assisted Topic Classification for Mixed-Methods Social Science Research

    Dustin Hillard, Stephen Purpura et al.•Journal of Information Technology…•2008

  • Applying LDA Topic Modeling in Communication Research

    Daniel Maier, Annie Waldherr et al.•Communication Methods and Measures•2018

  • Teaching the Computer to Code Frames in News

    Bjorn Burscher, Daan Odijk et al.•Communication Methods and Measures•2014

  • Scaling up Content Analysis

    Open Access•Damian Trilling, Jeroen Jonkman•Communication Methods and Measures•2018

  • Content Analysis as a Foundation for Programmatic Research in Communication

    Michael D Slater•Communication Methods and Measures•2013

  • Shifting toward a humanized perspective? Visual framing analysis of the coverage of refugees on CNN and Spiegel Online before and after the iconic photo publication of Alan Kurdi

    Open Access•Lea Hellmueller, Xu Zhang•Visual Communication•2019

  • Multimodal content analysis

    Open Access•Frank Serafini, Stephanie F Reid•Visual Communication•2019

  • When Does an Infographic Say More Than a Thousand Words

    Yael De Haan, Sanne Kruikemeier et al.•Journalism Studies•2017

  • Automated Solutions for Crowd Size Estimation

    Open Access•Muhammad Waqar Aziz, Farhan Naeem et al.•Social Science Computer Review•2017

  • Answering Mobile Surveys With Images

    Open Access•Oriol J Bosch, Melanie Revilla et al.•Social Science Computer Review•2018

  • Corporate media work and micro-dynamics of mediatization

    Open Access•Josef Pallas, Magnus Fredriksson•European Journal of Communication•2013

  • Using APIs for Data Collection on Social Media

    Stine Lomborg, Anja Bechmann•The Information Society•2014

  • Computer Vision Models to Categorize Art Collections According to the Visual Content

    Pilar Rosado, Pilar Rosado Rodrigo•Leonardo•2019

  • Contributing to Theory and Knowledge in Quantitative Communication Science

    Michael D Slater, Laurel S Gleason•Communication Methods and Measures•2012

  • Images that Matter

    Open Access•Andreu Casas, Nora Webb Williams•Political Research Quarterly•2019

  • Computational Research in the Post-API Age

    Deen Freelon•Political Communication•2018

  • Towards an Articulation of the Material and Visual Turn in Organization Studies

    Open Access•Eva Boxenbaum, Candace Jones et al.•Organization Studies•2018

  • Critical Questions for Big Data

    Drick Boyd, Danah Boyd et al.•Information Communication & Society•2012

  • Using Supervised Machine Learning to Code Policy Issues

    Open Access•Bjorn Burscher, R Vliegenthart et al.•The Annals of the American…•2015

  • The Power of Political Image

    Open Access•Mireille Lalancette, Vincent Raynauld•American Behavioral Scientist•2019

  • Picturing the Party

    Open Access•Kirill Filimonov, Uta Rußmann et al.•Social Media + Society•2016

  • The Psychological Meaning of Words

    Open Access•Yla R Tausczik, Yla Tausczik et al.•Journal of Language and Social…•2010

Unique citing works17
Citations per year3,4
Citation span2021 - 2026 (6)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 17

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae