1.1 Introduction
Sentiment analysis, also known as opinion mining, is the computational study of people's opinions, attitudes, and emotions expressed in written language (Liu, 2012). It involves using natural language processing, machine learning, and text analysis techniques to automatically identify and extract subjective information from text data (Cambria et al., 2017). In recent years, social media platforms such as Twitter, Facebook, and Instagram have become major channels through which individuals share their views, experiences, and reactions to products, services, events, and public policies (Medhat, Hassan & Korashy, 2014). The growing importance of social media monitoring stems from the need for real-time insights into public opinion. Organizations rely on sentiment analysis to track customer satisfaction, manage brand reputation, and respond promptly to emerging trends (Pak & Paroubek, 2010).
As a prelude to other parts of this study, this chapter will discuss the background upon which this study was initiated, the statement of problems that led to this study, the aim and objectives of the study. Others are significance of the study, scope of work, limitation of the study and definition of technical key terms.
1.2 Background of Study
With the rise of social media in the late 2000s, the volume of informal, user-generated content increased exponentially, which necessitated the development of more sophisticated sentiment analysis techniques. Traditional methods of analyzing social media data, such as manual coding or surveys, are insufficient for handling the speed and scale of modern digital communications. These methods are often labor-intensive, time-consuming, and susceptible to human bias, which limits their effectiveness (Cambria et al., 2017). On the other hand, intelligent sentiment analysis systems, which combine natural language processing (NLP) and machine learning techniques, offer scalable and automated solutions for extracting meaningful insights from large volumes of text data. Such systems are capable of understanding context, detecting nuances in language, and providing real-time feedback, which is critical for timely decision-making.
According to Liu (2012), sentiment analysis is the process of computationally identifying and categorizing opinions expressed in text to determine whether the writer's attitude toward a particular topic, product, or service is positive, negative, or neutral. Liu further reported that the growing volume of online content, particularly on social media platforms, has increased the demand for automated systems capable of efficiently processing and interpreting this data. Social media platforms such as Twitter, Facebook, and Instagram have become central to public communication, with millions of users sharing opinions daily.
Medhat, Hassan, and Korashy (2014) reported that, the existing sentiment analysis approaches often face challenges in handling informal language, slang, abbreviations, emojis, and sarcasm, which are prevalent in social media communication. They further reported that many current systems are designed for structured text and fail to adapt to the unique characteristics of social media posts, resulting in inaccurate sentiment classification. Pak and Paroubek (2010) contended that social media monitoring is essential not only for business intelligence but also for political campaigns, public health surveillance, and disaster management. They affirmed that sentiment analysis enables organizations to detect patterns in public opinion, identify emerging concerns, and predict trends, providing actionable insights that support strategic decision-making.
According to Hutto and Gilbert (2014), sentiment analysis of short, informal texts such as tweets requires specialized approaches to address challenges like character limits, abbreviations, and emoticons. They reported that models designed for longer, formal texts often fail when applied to social media, highlighting the need for intelligent systems tailored to these platforms. On the other hand, the ability to process vast amounts of data in real time enables organizations to respond proactively to crises, improve customer service, and make data-driven policy decisions.
Agarwal, Xie, Vovsha, Rambow, and Passonneau (2011) stated that social media sentiment analysis contributes to competitive intelligence by providing insights into consumer preferences, product reception, and brand perception. They further affirmed that companies leveraging such systems can improve marketing campaigns, enhance customer engagement, and identify potential risks before they escalate. The increasing reliance on social media for information dissemination, coupled with the need for rapid response to public sentiment, underscores the importance of developing intelligent, automated, and context-aware sentiment analysis systems.
It is against this backdrop that this study seeks to design and implement an intelligent sentiment analysis system for social media monitoring. The proposed system aims to provide accurate, scalable, and real-time insights into public opinion while overcoming challenges associated with informal, multilingual, and context-rich social media content. This study is set against the backdrop of growing demand for actionable intelligence from social media data and the limitations of existing sentiment analysis tools.
1.3 Statement of Problems
Based on the investigation conducted, the implemented system encounters a number of challenges, with some of the most significant issues outlined below:
- The existing social media platforms are generating massive volumes of user-generated content every day, and organizations are increasingly relying on insights from these platforms to understand public opinions, consumer preferences, and emerging trends.
- There is difficulty for traditional analytical methods to accurately interpret the emotions and opinions expressed in posts, comments, and reviews due to the dynamic and unstructured nature of social media data.
- The manual analysis of such data is labor-intensive, error-prone, and impractical for real-time decision-making, leading to delays in responding to customer concerns or public sentiments.
- The existing sentiment analysis tools often struggle with contextually rich language, sarcasm, slang, and multilingual expressions that are common on platforms like Twitter, Facebook, and Instagram, resulting in misclassification and limited accuracy.
- Lastly, many current systems are designed for general text and are not optimized for the high-velocity, short-text formats typical of social media, meaning they produce inconsistent results when applied to real-world online conversations.
1.4 Aim and Objectives of Study
The aim of this study is to design and implement an intelligent sentiment analysis system for social media monitoring that accurately detects, analyzes, and visualizes public opinion in real time. In achieving this aim, the following specific objectives were laid out as follows:
- To develop a sentiment analysis system capable of accurately classifying positive, negative, and neutral sentiments in social media data.
- To implement natural language processing and machine learning algorithms that improve context-awareness in sentiment detection.
- To design the system to handle informal, multilingual, and slang-heavy social media content.
- To provide real-time sentiment analysis with intuitive visualization tools for decision-makers.
- To evaluate the performance of the implemented system against existing sentiment analysis tools.
1.5 Significance of Study
It is believed that at the completion of the study, the system will provide a reliable tool for monitoring and analyzing public sentiment in social media data. The study will also improve decision-making processes by offering accurate, real-time insights into public opinion.
Furthermore, the system will facilitate timely responses to customer feedback, public concerns, and emerging trends. In addition, the new system will enhance organizational efficiency by automating sentiment detection and reducing the need for manual content analysis.
Lastly, the system will serve as a reference for future research and development in intelligent sentiment analysis technologies.
1.6 Scope of Study
The scope of this research is focused on designing and implementing a sentiment analysis system for social media monitoring within Lagos State, Nigeria. The system will analyze publicly available data from platforms such as Twitter and Facebook for organizations, businesses, and research institutions based in Lagos.
1.7 Limitations of the Study
During the course of this study, many things militated against its completion, some of which are:
- Time Constraint: The time frame given to accomplish this project was very short due to school academic calendar and it was carried out under pressure which made the researcher not to implement some necessary features.
- Financial Constraint: Insufficient fund tends to impede the efficiency of the researcher in sourcing for the relevant materials, literature or information and in the process of data collection (internet).
1.8 Definition of Terms
Sentiment Analysis:
According to Liu (2012), sentiment analysis is the computational process of determining whether a piece of text expresses positive, negative, or neutral sentiments.
Natural Language Processing (NLP):
Cambria et al. (2017) stated that NLP is a branch of artificial intelligence that enables computers to interpret, process, and generate human language.
Machine Learning:
According to Medhat, Hassan & Korashy (2014), machine learning is a subset of artificial intelligence where algorithms learn patterns from data to make predictions or decisions without explicit programming.
Social Media Monitoring:
Pak & Paroubek (2010) affirmed that social media monitoring involves tracking online conversations and opinions to understand public sentiment, trends, and engagement.
Real-Time Analysis:
Thelwall, Buckley & Paltoglou (2012) reported that real-time analysis is the immediate processing and evaluation of data as it is generated, enabling prompt responses to insights.
…