Transformer network-based word embeddings approach for autonomous cyberbullying detection

Abstract

Purpose

Nowadays people are connected by social media like Facebook, Instagram, Twitter, YouTube and much more. Bullies take advantage of these social networks to share their comments. Cyberbullying is one typical kind of harassment by making aggressive comments, abuses to hurt the netizens. Social media is one of the areas where bullying happens extensively. Hence, it is necessary to develop an efficient and autonomous cyberbullying detection technique.

Design/methodology/approach

In this paper, the authors proposed a transformer network-based word embeddings approach for cyberbullying detection. RoBERTa is used to generate word embeddings and Light Gradient Boosting Machine is used as a classifier.

Findings

The proposed approach outperforms machine learning algorithms such as logistic regression, support vector machine and deep learning models such as word-level convolutional neural networks (word CNN) and character convolutional neural networks with short cuts (char CNNS) in terms of precision, recall, F1-score.

Originality/value

One of the limitations of traditional word embeddings methods is context-independent. In this work, only text data are utilized to identify cyberbullying. This work can be extended to predict cyberbullying activities in multimedia environment like image, audio and video.

Citation

Pericherla, S. and Ilavarasan, E. (2024), "Transformer network-based word embeddings approach for autonomous cyberbullying detection", International Journal of Intelligent Unmanned Systems, Vol. 12 No. 1, pp. 154-166. https://doi.org/10.1108/IJIUS-02-2021-0011