Development and Evaluation of Life-Threatening Statement Detection Models for Social Media Platforms Using Supervised Machine Learning Algorithms
DOI:
https://doi.org/10.59461/ijdiic.v5i2.269Keywords:
Cyberbullying, Deep learning, Large language model, Life-threatening statement, Machine learning, Social media platformsAbstract
In today’s digital age, threats to life have become alarmingly common, infiltrating everything from social media platforms to personal communications. About 11.3% of people experienced suicidal ideation over the past year, 5.5% of adults in the United States reported serious suicidal thoughts in the past year, and 10-14% of children and adolescents experienced cyberbullying globally. This study developed machine learning models to detect life-threatening statements across different model categories by employing hyperparameter tuning and Adam optimization. Six models were built using RF, SVM, FFNN, LSTM, pre-trained BERT, and T5, and evaluated using benefit and cost measures and confusion matrices. The outcome indicates that the six models performed well, but the FFNN model outperformed all other models by achieving an accuracy of 98.86%, precision of 98.86%, MCC of 97.72%, Recall of 98.86%, MAE of 0.0113, and RMSE of 0.1067. It also achieved the highest number of accurately classified instances and the lowest number of misclassified instances, which demonstrates that the FFNN model exhibits robustness and precision, making it highly reliable for detecting life-threatening statements compared to other models. Having achieved a very high accuracy, the method still lacks an in-depth understanding of contextual information. Therefore, further studies may focus on incorporating contextual information for more accurate classification of life-threatening statements and integrating the developed model into a real-time detection system.
Downloads
References
S. Hinduja and J. W. Patchin, “Cyberbullying: An Exploratory Analysis of Factors Related to Offending and Victimization,” Deviant Behavior, vol. 29, no. 2, pp. 129–156, Jan. 2008, https://doi.org/10.1080/01639620701457816.
M. L. Ybarra and K. J. Mitchell, “Online aggressor/targets, aggressors, and targets: a comparison of associated youth characteristics,” Journal of Child Psychology and Psychiatry, vol. 45, no. 7, pp. 1308–1316, Oct. 2004, https://doi.org/10.1111/j.1469-7610.2004.00328.x.
J. W. Patchin and S. Hinduja, “Measuring cyberbullying: Implications for research,” Aggression and Violent Behavior, vol. 23, pp. 69–74, Jul. 2015, https://doi.org/10.1016/j.avb.2015.05.013.
M. ŞAHİN, “The relationship between the cyberbullying/cybervictmization and loneliness among adolescents,” Children and Youth Services Review, vol. 34, no. 4, pp. 834–837, Apr. 2012, https://doi.org/10.1016/j.childyouth.2012.01.010.
J. Juvonen and E. F. Gross, “Extending the School Grounds?—Bullying Experiences in Cyberspace,” Journal of School Health, vol. 78, no. 9, pp. 496–505, Sep. 2008, https://doi.org/10.1111/j.1746-1561.2008.00335.x.
B. P. Nkwanyana, "Psychosocial effects of cyberbullying in selected secondary schools, KwaZulu-Natal, South Africa," Interdisciplinary Journal of Education Research, vol. 7, no. s1, p. a12, Apr. 2025, https://doi.org/10.38140/ijer-2025.vol7.s1.12.
A. Albanyan, A. Hassan, and E. Blanco, “Not All Counterhate Tweets Elicit the Same Replies: A Fine-Grained Analysis,” in Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023), 2023, pp. 71–88, https://doi.org/10.18653/v1/2023.starsem-1.8.
B. Vidgen et al., “Detecting East Asian Prejudice on Social Media,” in Proceedings of the Fourth Workshop on Online Abuse and Harms, 2020, pp. 162–172, https://doi.org/10.18653/v1/2020.alw-1.19.
E. Jackson, M. Boyes, B. Blundell, J. Hirn, and S. Leitão, “Managing cyberbullying among adolescents with neurodevelopmental disorders: A scoping review,” International Journal of Speech-Language Pathology, vol. 27, no. 3, pp. 341–356, May 2025, https://doi.org/10.1080/17549507.2025.2451305.
E. Raisi and B. Huang, “Cyberbullying Identification Using Participant-Vocabulary Consistency,” Jun. 2016, https://doi.org/10.48550/arXiv.1606.08084.
M. Almaliki, A. M. Almars, I. Gad, and E.-S. Atlam, “ABMM: Arabic BERT-Mini Model for Hate-Speech Detection on Social Media,” Electronics, vol. 12, no. 4, p. 1048, Feb. 2023, https://doi.org/10.3390/electronics12041048.
E. Rajesh Kumar, K. V. S. N. Rama Rao, S. R. Nayak, and R. Chandra, “Suicidal ideation prediction in twitter data using machine learning techniques,” Journal of Interdisciplinary Mathematics, vol. 23, no. 1, pp. 117–125, Jan. 2020, https://doi.org/10.1080/09720502.2020.1721674.
N. Maqbool, A. Anjum, M. Z. Hussain, T. Aslam, A. Yaseen, and M. Z. Hasan, “FROM DETECTION TO PRECISION : ELEVATING HATE SPEECH CLASSIFICATION WITH CUTTING-EDGE MODELS,” Spectrum of Engineering Sciences, vol. 3, no. 5, pp. 143–158, 2025.
C. Ren, D. Jeong, M. Wu, Y. Huang, Y. Gao, and Y. Li, “A survey of multimodal hate meme detection,” Expert Systems with Applications, vol. 323, p. 132507, Aug. 2026, https://doi.org/10.1016/j.eswa.2026.132507.
K. Solovev and N. Pröllochs, “Moralized language predicts hate speech on social media,” PNAS Nexus, vol. 2, no. 1, Jan. 2023, https://doi.org/10.1093/pnasnexus/pgac281.
S. Arnon et al., “Association of Cyberbullying Experiences and Perpetration With Suicidality in Early Adolescence,” JAMA Network Open, vol. 5, no. 6, p. e2218746, Jun. 2022, https://doi.org/10.1001/jamanetworkopen.2022.18746.
J. O. Okesola et al., “Predictive analytics on crop yield using supervised learning techniques,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 36, no. 3, p. 1664, Dec. 2024, https://doi.org/10.11591/ijeecs.v36.i3.pp1664-1673.
J. E. T. Akinsola, M. A. Olatunbosun, I. M. Olaniyi, M. A. Adeagbo, E. A. Olajubu, and G. A. Aderounmu, “Application of Artificial Intelligence on MNIST Dataset for Handwritten Digit Classification for Evaluation of Deep Learning Models,” Acadlore Transactions on AI and Machine Learning, vol. 4, no. 3, pp. 219–234, 2025, https://doi.org/https://doi.org/10.565 78/ataiml040305.
G. Ciaburro, G. Iannace, and V. Puyana-Romero, “Sentiment Analysis-Based Method to Prevent Cyber Bullying,” 2022, pp. 721–735.
R. Yoshida, S. Yoshida, and M. Muneyasu, “MAHGA: Multi-Aspect Heterogeneous Graph Analysis for Harmful Speech Detection on Social Networks,” IEEE Access, vol. 13, pp. 106673–106689, 2025, https://doi.org/10.1109/ACCESS.2025.3581214.
J. M. Pérez et al., “Assessing the Impact of Contextual Information in Hate Speech Detection,” IEEE Access, vol. 11, pp. 30575–30590, 2023, https://doi.org/10.1109/ACCESS.2023.3258973.
M. Joshi, D. Pandey, V. Pandey, and M. W. Khan, “A fusion framework for Hinglish cyberbullying detection using mBERT and FastText,” International Journal of Engineering in Computer Science, vol. 7, no. 1, pp. 7–14, Jan. 2025, https://doi.org/10.33545/26633582.2025.v7.i1a.149.
M. Rehan, M. S. I. Malik, and M. M. Jamjoom, “Fine-Tuning Transformer Models Using Transfer Learning for Multilingual Threatening Text Identification,” IEEE Access, vol. 11, pp. 106503–106515, 2023, https://doi.org/10.1109/ACCESS.2023.3320062.
G. Arya et al., “Multimodal Hate Speech Detection in Memes Using Contrastive Language-Image Pre-Training,” IEEE Access, vol. 12, pp. 22359–22375, 2024, https://doi.org/10.1109/ACCESS.2024.3361322.
T. T. Nguyen, C. Wilson, and J. Dalins, “Large Language Models for Detection of Life-Threatening Texts,” 2025, pp. 311–323.
I. Priyadarshini, S. Sahu, and R. Kumar, “A transfer learning approach for detecting offensive and hate speech on social media platforms,” Multimedia Tools and Applications, vol. 82, no. 18, pp. 27473–27499, Jul. 2023, https://doi.org/10.1007/s11042-023-14481-3.
A. B. Mathew, “Novel Artificial Intelligence Model for Chapter-wise Summarization from Books,” International Journal for Research in Applied Science and Engineering Technology, vol. 12, no. 6, pp. 2216–2228, Jun. 2024, https://doi.org/10.22214/ijraset.2024.63469.
P. Nagvekar, N. Bhanushali, D. Bhandary, and D. S. Tamboli, “Cyberbullying : Analyzing its Impact and Prevention Strategies,” IJNRD2504557 International Journal Of Novel Research And Development, vol. 10, no. 4, pp. 517–519, 2025.
C. Tank et al., “Su-RoBERTa: A Semi-supervised Approach to Predicting Suicide Risk through Social Media using Base Language Models,” Dec. 2024, https://doi.org/10.48550/arXiv.2412.01353.
S. Das, K. Bhattacharyya, and S. Sarkar, “Performance Analysis of Logistic Regression, Naive Bayes, KNN, Decision Tree, Random Forest and SVM on Hate Speech Detection from Twitter,” International Research Journal of Innovations in Engineering and Technology, vol. 07, no. 03, pp. 07–03, 2023, https://doi.org/10.47001/IRJIET/2023.703004.
Y. Zheng and Y. Zhao, “A critical review on the study of threatening in English,” Forum for Linguistic Studies, vol. 2, no. 1, p. 71, Sep. 2020, https://doi.org/10.18063/fls.v2i1.1206.
Renju K and Brunda V, “Optimizing Crop Yield Prediction through Multiple Models: An Ensemble Stacking Approach,” International Journal of Data Informatics and Intelligent Computing, vol. 3, no. 2, pp. 52–58, Jun. 2024, https://doi.org/10.59461/ijdiic.v3i2.120.
M. Alipio and M. Bures, “Intelligent Network Maintenance Modeling for Fixed Broadband Networks in Sustainable Smart Homes,” IEEE Internet of Things Journal, vol. 10, no. 20, pp. 18067–18081, Oct. 2023, https://doi.org/10.1109/JIOT.2023.3277590.
G. Van Houdt, C. Mosquera, and G. Nápoles, “A review on the long short-term memory model,” Artificial Intelligence Review, vol. 53, no. 8, pp. 5929–5955, Dec. 2020, https://doi.org/10.1007/s10462-020-09838-1.
J. M. Navarro, R. Martínez-España, A. Bueno-Crespo, R. Martínez, and J. M. Cecilia, “Sound Levels Forecasting in an Acoustic Sensor Network Using a Deep Neural Network,” Sensors, vol. 20, no. 3, p. 903, Feb. 2020, https://doi.org/10.3390/s20030903.
J. A. L. Marques, F. N. B. Gois, J. P. do V. Madeiro, T. Li, and S. J. Fong, “Artificial neural network-based approaches for computer-aided disease diagnosis and treatment,” in Cognitive and Soft Computing Techniques for the Analysis of Healthcare Data, Elsevier, 2022, pp. 79–99.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.” 2019, https://doi.org/10.18653/v1%2FN19-1423.
A. Vaswani et al., “Attention Is All You Need,” Aug. 2023, https://doi.org/10.5555/3295222.3295349.
M. Alruily, A. Manaf Fazal, A. M. Mostafa, and M. Ezz, “Automated Arabic Long-Tweet Classification Using Transfer Learning with BERT,” Applied Sciences, vol. 13, no. 6, p. 3482, Mar. 2023, https://doi.org/10.3390/app13063482.
Y. Dong, G. Ifrim, D. Mladenić, C. Saunders, and S. Van Hoecke, Eds., Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track, vol. 12461. Cham: Springer International Publishing, 2021.
G. Anitha, G. Karthik, R. Chadge, M. Dinesh, T. D. Subha, and A. Al Sherideh, “A Novel Methodology Design to Predict Hate Speech on Social Media Using Machine Learning Principles,” 2024 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES), pp. 1–6, Dec. 2024, https://doi.org/10.1109/ICSES63760.2024.10910624.
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ifeoluwa Michael Olaniyi, Jide Ebenezer Taiwo Akinsola, Maryann Gold Azodo, Fathia Oluwadamilola Onipede, Emmanuel Ajayi Olajubu, Ganiyu Adesola Aderounmu
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
