GuardHarMem and HarMDetect
A multimodal dataset and benchmlark model for fine-grained harmful meme classification
Bibliographic Data
| ID | 16858882 |
|---|---|
| Authors | Samir El-amrany (0009-0007-2305-5185, University of Luxembourg, corresponding author), Salima Lamsiyah (0000-0001-8789-5713, University of Luxembourg), Matthias R Brust (0000-0001-8155-0626, University of Luxembourg), Pascal Bouvry (0000-0001-9338-2834, University of Luxembourg) |
| Year | 2025 |
| Volume | 15 |
| Issue | 1 |
| Publication date | 2025-06-26 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Social Network Analysis and Mining (JOURNAL) |
| Journal identifiers | ISSN: 1869-5450 • E-ISSN: 1869-5469 |
| Publisher | Springer Science and Business Media LLC (PUBLISHER) |
| DOI | 10.1007/s13278-025-01475-2 |
| OpenAlex | W4411663626 |
| Language | EN |
| Citations received | 1 |
| References cited | 41 |
Harmful content on social media, especially in the form of memes, poses unique challenges for moderation and analysis. Memes combine text and imagery to convey complex messages rapidly and evoke emotional responses, enabling the dissemination of harmful ideas, reinforcement of stereotypes, and normalization of discriminatory behaviour, often eluding standard moderation tools. Existing datasets, such as Hateful Memes ( $$\approx$$ 10 K samples) and Memotion ( $$\approx$$ 8 K samples) focus on binary or coarse-grained labels and omit many common forms of harm. To address this gap, we introduce GuardHarMem, a new corpus of $$\approx$$ 16.6 K memes annotated with fine-grained categories including racism, mockery, and promotion of harmful substances. We also present HarMDetect a practical baseline multimodal classifier that integrates text, image, and automatically extracted captions. By applying targeted data augmentation strategies, we enhance model robustness on GuardHarMem, HarMDetect outperforms baseline transformers for both binary and multiclass classification. The dataset and code are publicly available at https://github.com/EL-Amrany/Harmful-memes-detection
Machine learning · Computer Science · Cybercrime and Law Enforcement Studies · Hate Speech and Cyberbullying Detection · Spam and Phishing Detection · Artificial Intelligence
| Citations per year | 1 |
|---|---|
| Citation span | 2026 - 2026 (1) |
| Highly cited | No |