Like Walking a Tightrope

User-Centric Perspectives on Content in Need of Moderation

Bibliographic Data

ID24217864
AuthorsAnna Maria Planitzer (0000-0001-8181-6615, University of Vienna), Svenja Schäfer (0000-0002-6401-1564, Wageningen University & Research, The Netherlands), Pia Pachinger (0009-0007-7490-0422, TU Wien), Sophie Lecheler (0000-0001-7320-1012, University of Vienna)
Year2026
Volume12
Issue3
Publication date2026-07-01
Open AccessYes
TypeARTICLE
VenueSocial Media + Society (JOURNAL)
Journal identifiersISSN: 2056-3051 • E-ISSN: 2056-3051
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/20563051261479963
OpenAlexW7214551496
LanguageEN
References cited56

Norm-violating content on social media platforms is on the rise, fueling prejudice and polarization. To counter such developments in a timely manner, platforms rely on automated content moderation. The issue, however, is that current understandings of automated moderation are mostly elite-driven, neglecting individual user perspectives, introducing biases and discrimination, and overlooking that users’ perspectives on what constitutes a norm violation in the first place may differ substantially from those of experts and platforms. Therefore, this study uses focus groups to explore what type of content users themselves think is in need of moderation. Findings suggest that users, while acknowledging the importance of moderating polarized topics (e.g., migration) and uncivil discourse styles (e.g., insults), are more concerned with the motivations of perpetrators and the vulnerability of targets. Our findings show that, if platforms want to incorporate user perspectives when designing automated moderation systems, they must move beyond merely detecting problematic message characteristics and focus on more tailored approaches, alongside accountability measures for perpetrators and safety measures for victims.

automated content moderation · insults · Migration · perpetrator accountability · platform design · Prejudice · social media polarization · uncivil discourse · user perspective · victim safety · Hate Speech and Cyberbullying Detection · Misinformation and Its Impacts · Social Media and Politics

Tools

Open DOIOpen Access