Design Principles for Enhancing AI-Assisted Moderation in Hate Speech Detection on Social Media Platforms
DOI:
https://doi.org/10.35870/ijsecs.v4i2.2345Keywords:
Hate Speech Detection, Social Media Moderation, AI-based Decision Support, Explainable AI (XAI), Transfer Learning, User Interface DesignAbstract
Hate speech on social media poses a growing threat to individuals and society, necessitating technological support for moderators in detecting and addressing problematic content. This article explores the design principles essential for creating effective user interfaces (UIs) in decision support systems that employ artificial intelligence (AI) to aid human moderators. Through a comprehensive study involving 641 participants across three design cycles, we qualitatively and quantitatively evaluate various design options. Our assessment encompasses perceived ease of use, usefulness, and intention to use, while also delving into the impact of AI explainability on users' cognitive efforts, informativeness perception, mental models, and trustworthiness. Notably, software developers affirm the high reusability of the proposed design principles. The findings reveal that well-designed UIs can significantly enhance the effectiveness of AI-based moderation tools, providing clear and understandable explanations that improve user trust and engagement. By addressing both technical and user-centered aspects, this research contributes to the development of more robust and user-friendly AI systems for hate speech detection. Future work should focus on further refining these principles and exploring their applicability in diverse social media contexts to ensure comprehensive and adaptable solutions for content moderation.
Downloads
References
Lampropoulos, G., Ferdig, R. E., & Kaplan-Rakowski, R. (2023). A social media data analysis of general and educational use of ChatGPT: Understanding emotional educators. Available at SSRN 4468181. https://dx.doi.org/10.2139/ssrn.4468181
Asghar, M. Z., Barbera, E., Rasool, S. F., Seitamaa-Hakkarainen, P., & Mohelská, H. (2023). Adoption of social media-based knowledge-sharing behaviour and authentic leadership development: evidence from the educational sector of Pakistan during COVID-19. Journal of Knowledge Management, 27(1), 59-83. https://doi.org/10.1108/JKM-11-2021-0892
Abdul-Rahman, M., Adegoriola, M. I., McWilson, W. K., Soyinka, O., & Adenle, Y. A. (2023). Novel use of social media big data and artificial intelligence for community resilience assessment (CRA) in university towns. Sustainability, 15(2), 1295. https://doi.org/10.3390/su15021295.
Hatmal, M. M. M., Al-Hatamleh, M. A., Olaimat, A. N., Mohamud, R., Fawaz, M., Kateeb, E. T., ... & Bindayna, K. M. (2022). Reported adverse effects and attitudes among Arab populations following COVID-19 vaccination: a large-scale multinational study implementing machine learning tools in predicting post-vaccination adverse effects based on predisposing factors. Vaccines, 10(3), 366. https://doi.org/10.3390/vaccines10030366.
Ahmed, A. L., & Ahmad, E. (2023). The future of New Zealand tertiary education: Generation alpha.
Miller, D. (2023). Exploring the impact of artificial intelligence language model ChatGPT on the user experience. International Journal of Technology, Innovation and Management (IJTIM), 3(1), 1-8. https://doi.org/10.54489/ijtim.v3i1.195.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2024 Alex Graf, Danny Coolsaet
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.
