Can I read Sentiment Analysis of Short Informal Text by Tuning BERT - Bi-LSTM Model on EtoBox?

Sentiment Analysis of Short Informal Text by Tuning BERT - Bi-LSTM Model by Shreyas Agrawal; Sumanto Dutta; Bidyut Kr. Patra is a scholarly article available to read on EtoBox.

What is Sentiment Analysis of Short Informal Text by Tuning BERT - Bi-LSTM Model about?

Sentiment analysis is one of the significant tasks in processing natural language by a machine. However, it is difficult for a machine to understand the feelings of a person and opinion about a topic. Many approaches have been introduced for analyzing sentiment from long text in recent past. In contrast, these approaches fail to address the small length text problem like Twitter data efficiently. Recent advances in the pre-trained contextualized embeddings like Bidirectional Encoder Representations from Transformers (BERT) show far greater accuracy than traditional embeddings. In this paper, we develop a novel architecture to tune the BERT using a Bidirectional Long Short-Term Memory (Bi-LSTM) model. A task-specific layer is incorporated along with the BERT in the proposed model. Our model extracts sentiment from short texts, especially Twitter data. The extensive experiments show the superiority of our model over state-of-the-art models in sentiment analysis task across several gold standard datasets.

Author

Shreyas Agrawal; Sumanto Dutta; Bidyut Kr. Patra

Publisher

IEEE

Published

2021

Language

EN