Data Analytics $$

a) What is Text Analytics?

Text Analytics is the process of extracting meaningful insights from unstructured text data using
techniques like NLP, sentiment analysis, and topic modeling.

b) What is an Outlier?
An outlier is a data point that is significantly different from other observations in a dataset, often
indicating errors or rare events.

c) Define Deep Learning.

Deep Learning is a subset of Machine Learning that uses artificial neural networks with multiple
layers to process complex data and recognize patterns.

d) What is Sentiment Analysis?

Sentiment Analysis is the process of determining the emotional tone (positive, negative, or neutral)
of text, often used in social media monitoring and customer feedback.

e) Define Community Detection.

Community Detection is a technique used in network analysis to identify groups of nodes that are
more densely connected to each other than to the rest of the network.

f) What is the Purpose of FP-Growth Algorithm?

The FP-Growth algorithm is used for finding frequent itemsets in large datasets efficiently without
generating candidate itemsets, improving performance over Apriori.

g) What is Classification?
Classification is a supervised learning technique that categorizes data into predefined classes, such
as spam detection (spam or not spam).

h) List Any Two Applications of Data Mining.

1. Fraud Detection in Banking

2. Customer Segmentation in Marketing

i) What is Mechanistic Analysis?

Mechanistic Analysis is a method of studying systems by understanding the underlying rules and
processes that govern them, often used in physics and biology.

a) Define Data Analytics.

Data Analytics is the process of examining raw data to find patterns, trends, and useful insights to
help in decision-making.

b) Define Tokenization.
Tokenization is the process of breaking text into smaller parts called "tokens," such as words or
sentences, for easier analysis.

c) Define Machine Learning.

Machine Learning is a branch of artificial intelligence (AI) that enables computers to learn from
data and make decisions without being explicitly programmed.

d) What is clustering?
Clustering is a technique in data analytics that groups similar data points together based on common
characteristics.
e) What is Frequent Itemset?
A Frequent Itemset is a set of items that appear together frequently in a dataset, often used in market
basket analysis.

f) What is data characterization?

Data characterization is the process of summarizing and describing important features of data, such
as patterns and trends.

g) What is outlier?
An outlier is a data point that is very different from other data points in a dataset, often due to errors
or rare events.

h) What is Bag of Words?

Bag of Words (BoW) is a method in natural language processing where a text is represented as a
collection of words, ignoring grammar and word order.

i) What is Text Analytics?

Text Analytics is the process of analyzing and extracting meaningful information from text data
using techniques like NLP and machine learning.

j) Define Trend Analytics.

Trend Analytics is the study of patterns and changes in data over time to predict future movements
and make informed decisions.

a) Define Data Analytics.

Data Analytics is the process of collecting, organizing, and analyzing data to discover useful
patterns, trends, and insights. It helps in decision-making across various industries like business,
healthcare, and finance.

b) What is AVC & ROC curve?

The ROC (Receiver Operating Characteristic) curve is a graphical representation of a
classification model’s performance, showing the trade-off between the True Positive Rate (TPR)
and False Positive Rate (FPR). The AUC (Area Under Curve) measures the overall effectiveness
of the classifier, where a higher AUC value indicates better model performance.

c) Write any two applications of Supervised Machine Learning.

1. Spam Detection – Email services use supervised learning models to classify emails as spam
or non-spam based on labeled data.
2. Fraud Detection – Banks and financial institutions use it to identify fraudulent transactions
by analyzing past transaction data.

d) Give the formula for support & confidence.

• Support = (Frequency of itemset) / (Total number of transactions)

• Confidence = (Frequency of transactions containing both X and Y) / (Frequency of
transactions containing X)
These formulas are commonly used in association rule mining to find relationships in data.
e) What is an outlier?
An outlier is a data point that significantly differs from the rest of the dataset. It may be caused by
errors in data collection, rare events, or natural variations. Outliers can affect statistical analysis and
machine learning models.

f) State applications of NLP.

1. Chatbots & Virtual Assistants – NLP powers AI-based chatbots like Siri and Alexa to
understand and respond to human queries.
2. Sentiment Analysis – Businesses use NLP to analyze customer reviews and social media
comments to determine public opinion about their products.

g) What is web scraping?

Web scraping is the process of automatically extracting data from websites using tools or scripts. It
is commonly used for price comparison, market research, and data collection from online sources.

h) What is the purpose of n-gram?

An n-gram is a sequence of 'n' words used in text analysis and NLP. It helps in language modeling,
word prediction, and text generation. For example, in a bigram (n=2) model, the phrase "machine
learning" is considered as a single unit to improve text processing accuracy.

i) Define classification.
Classification is a type of supervised learning where the model categorizes data into predefined
groups or labels. Examples include classifying emails as spam or not spam and identifying
handwritten digits.

j) Define Recall.
Recall, also known as Sensitivity, measures how well a model identifies all actual positive cases. It
is calculated as:
Recall = (True Positives) / (True Positives + False Negatives)
A high recall value means the model successfully detects most of the actual positive cases, making
it useful in applications like medical diagnosis and fraud detection.

a) State Occam’s Razor Principle.

Occam’s Razor states that among multiple possible explanations, the simplest one is preferred. In
machine learning, it means choosing the simplest model that fits the data well.

c) What is Supervised Learning?

Supervised Learning is a type of machine learning where a model is trained using labeled data,
meaning input-output pairs are provided to learn from. Example: Email spam detection.

d) What is TF-IDF?
TF-IDF (Term Frequency-Inverse Document Frequency) is a technique used in text analysis to
measure the importance of a word in a document relative to a collection of documents. It helps in
identifying relevant keywords.

e) What is Frequent Itemset?

A Frequent Itemset is a set of items that appear together frequently in a dataset, commonly used in
market basket analysis to find product associations.
f) Define Stemming.
Stemming is the process of reducing words to their root form, e.g., "running" becomes "run." It is
used in text processing to standardize words.

g) What is Link Prediction?

Link Prediction is a technique used in network analysis to predict future connections between nodes
in a graph, such as friend recommendations on social media.

h) State Applications of AI.

1. Healthcare – AI helps in disease diagnosis and medical imaging.

2. Finance – AI detects fraud and automates trading.

i) State Types of Logistic Regression.

1. Binary Logistic Regression – Used when the outcome has two categories (e.g., spam or not
spam).
2. Multinomial Logistic Regression – Used when there are three or more categories without
order (e.g., types of fruits).
3. Ordinal Logistic Regression – Used when categories have a meaningful order (e.g., ratings:
low, medium, high).

j) Define Precision.
Precision is a metric that measures how many of the predicted positive cases are actually correct.

Formula:
Precision = (True Positives) / (True Positives + False Positives)

A high precision means fewer false positives, making it important in applications like spam
detection

Q2
a) Explain the Term n-gram with Example

An n-gram is a sequence of n words or characters from a given text. It is used in Natural

Language Processing (NLP) for text analysis, such as text prediction and sentiment analysis.

Example:

For the sentence "I love data science", the n-grams are:

• Unigram (1-gram): "I", "love", "data", "science"

• Bigram (2-gram): "I love", "love data", "data science"
• Trigram (3-gram): "I love data", "love data science"

N-grams help in speech recognition, machine translation, and autocomplete features.

b) Explain Any Two Artificial Intelligence (AI) Applications

1. Chatbots & Virtual Assistants:

o AI-powered chatbots like Siri, Alexa, and Google Assistant help users by responding
to voice commands and queries.
2. Healthcare & Disease Diagnosis:
o AI helps in early disease detection using medical imaging and predictive analytics
(e.g., cancer detection in X-rays).

AI is widely used in automation, finance, robotics, and self-driving cars.

c) What is POS Tagging? Give Example

POS (Part-of-Speech) Tagging is a process in NLP where each word in a sentence is labeled with
its grammatical category (noun, verb, adjective, etc.).

Example:

For the sentence "She plays football", the POS tags are:

• "She" – Pronoun (PRP)

• "plays" – Verb (VBZ)
• "football" – Noun (NN)

POS tagging helps in speech recognition, text summarization, and machine translation.

d) What is Clustering? State Types of Clustering

Clustering is an unsupervised learning technique used to group similar data points together based
on patterns and similarities.

Types of Clustering:

1. Partitioning Clustering (e.g., K-Means):

o Divides data into fixed clusters.
2. Hierarchical Clustering:
o Forms a tree-like structure of nested clusters.
3. Density-Based Clustering (e.g., DBSCAN):
o Groups points based on density, useful for irregular data patterns.

Clustering is used in customer segmentation, fraud detection, and anomaly detection.

e) State the Ways to Improve Efficiency of Apriori Algorithm

1. Reducing Candidate Itemsets:

o Use hash-based techniques to reduce unnecessary combinations.
2. Using FP-Growth Algorithm:
o FP-Growth (Frequent Pattern Growth) is faster than Apriori and avoids generating
multiple candidate sets.
a) What is Confusion Matrix?
A Confusion Matrix is a table used to evaluate the performance of a classification model. It shows
the actual vs. predicted values and includes four components:

• True Positive (TP) – Correctly predicted positive cases.

• True Negative (TN) – Correctly predicted negative cases.
• False Positive (FP) – Incorrectly predicted positive cases (Type I error).
• False Negative (FN) – Incorrectly predicted negative cases (Type II error).
It helps in calculating metrics like accuracy, precision, recall, and F1-score.

b) Define Support and Confidence in Association Rule Mining.

• Support measures how frequently an itemset appears in the dataset.

Formula: Support = (Frequency of itemset) / (Total transactions)
• Confidence measures how often a rule is found to be true.
Formula: Confidence = (Frequency of transactions containing both X and Y) / (Frequency
of transactions containing X)
These metrics help in identifying strong relationships between items in datasets, such as in
market basket analysis.

c) Explain any two Machine Learning (ML) Applications.

1. Spam Detection – Machine learning is used in email filtering systems to classify emails as
spam or non-spam based on past data patterns.
2. Fraud Detection – ML models analyze transaction patterns to identify suspicious or
fraudulent activities in banking and e-commerce.

d) Write a short note on Stop Words.

Stop words are commonly used words (e.g., "is," "the," "and") that do not add much meaning to
text and are often removed in Natural Language Processing (NLP). Removing stop words improves
efficiency in tasks like search engines, sentiment analysis, and text classification.

e) Define Supervised Learning and Unsupervised Learning.

• Supervised Learning – A type of machine learning where the model is trained using labeled
data, meaning input-output pairs are provided (e.g., spam detection, image classification).
• Unsupervised Learning – A type of machine learning where the model finds hidden
patterns in data without labeled outputs (e.g., customer segmentation, anomaly detection).

a) Explain the concept of Underfitting & Overfitting.

• Underfitting occurs when a machine learning model is too simple and fails to capture
patterns in the data, leading to poor performance on both training and test data.
• Overfitting happens when a model is too complex and learns noise along with actual
patterns, performing well on training data but poorly on new test data.
A balanced model is needed to generalize well to unseen data.
b) What is Linear Regression? What type of Machine Learning applications can be solved
with Linear Regression?
Linear Regression is a supervised learning algorithm that finds a relationship between a dependent
variable (Y) and one or more independent variables (X) using a straight-line equation:
Y = mX + c (for simple linear regression).

Applications:

1. Predicting House Prices – Uses factors like area, number of rooms, and location.
2. Sales Forecasting – Predicts future sales based on historical data.

c) What is Social Media Analytics?

Social Media Analytics is the process of collecting, analyzing, and interpreting data from social
media platforms to gain insights about user behavior, trends, and brand performance. It helps
businesses improve marketing strategies and customer engagement.

d) What are the advantages of the FP-Growth Algorithm?

1. Efficient – It processes large datasets faster than Apriori by using a tree structure.
2. No Candidate Generation – Unlike Apriori, FP-Growth does not generate candidate
itemsets, making it memory-efficient.
3. Scalable – It works well with large databases and handles complex association rule mining
effectively.

e) What are Dependent & Independent Variables?

• Dependent Variable – The variable being predicted or affected in an analysis (e.g., house
price in a price prediction model).
• Independent Variable – The variable(s) used to predict the dependent variable (e.g., area,
number of rooms, and location in a house price model).

a) State types of Machine Learning. Explain any one in detail.

The three main types of machine learning are:

1. Supervised Learning – Uses labeled data to train the model (e.g., spam detection).
2. Unsupervised Learning – Finds hidden patterns in data without labels (e.g., customer
segmentation).
3. Reinforcement Learning – Uses rewards and penalties to learn optimal actions (e.g., game-
playing AI).

Explanation of Supervised Learning:

In Supervised Learning, the model is trained using input-output pairs where the correct answer is
provided. The goal is to learn a mapping from input to output.
Example: A spam detection system is trained using past emails labeled as "spam" or "not spam,"
allowing it to classify new emails correctly.
b) How is a Receiver Operating Characteristic (ROC) Curve Created?
The ROC Curve is created by plotting the True Positive Rate (TPR) against the False Positive
Rate (FPR) at different classification thresholds. The steps to create it:

1. Train the classification model and obtain prediction scores.

2. Set multiple threshold values to classify results as positive or negative.
3. Calculate TPR (Sensitivity) and FPR for each threshold.
4. Plot TPR vs. FPR to visualize the model's performance.
A model with a higher Area Under the Curve (AUC) is considered better.

c) What is an Association Rule? Give one example.

An Association Rule is used in data mining to find relationships between items in large datasets. It
is expressed as X → Y, meaning if item X is bought, item Y is likely to be bought too.

Example: In a supermarket, if customers frequently buy "Bread" and "Butter" together, the
association rule can be:
Bread → Butter (Support: 30%, Confidence: 80%)
This means 30% of transactions contain both items, and when bread is bought, there is an 80%
chance butter is also bought.

d) What is Influence Maximization?

Influence Maximization is the process of identifying key individuals in a social network who can
maximize the spread of information, trends, or products. It is widely used in viral marketing, social
media campaigns, and political promotions to ensure the message reaches the largest audience with
minimal effort.

e) Explain the Knowledge Discovery in Database (KDD) Process.

The KDD Process is a series of steps used to extract useful knowledge from large datasets. The key
steps are:

1. Data Selection – Identify and collect relevant data.

2. Data Preprocessing – Clean, remove noise, and handle missing values.
3. Data Transformation – Convert data into a suitable format.
4. Data Mining – Apply algorithms to discover patterns and insights.
5. Pattern Evaluation – Analyze and validate discovered patterns.
6. Knowledge Presentation – Present the results in an understandable way (e.g., reports,
graphs).

This process helps in decision-making and is widely used in fields like business, healthcare, and
finance
Q3

a) Explain Life Cycle of Data Analytics [4 Marks]

The Data Analytics Life Cycle consists of structured steps used to process and analyze data to
extract meaningful insights. The main phases are:

1. Data Collection:

• Gather raw data from sources like databases, IoT devices, social media, or surveys.
• Ensure data is relevant and reliable.

2. Data Cleaning & Preparation:

• Handle missing values, remove duplicates, and correct inconsistencies.

• Convert unstructured data into a structured format for analysis.

3. Data Exploration & Analysis:

• Perform Exploratory Data Analysis (EDA) using statistical methods and visualizations.
• Identify patterns, trends, and outliers in the dataset.

4. Model Building & Evaluation:

• Apply machine learning algorithms like regression, classification, or clustering.

• Evaluate model performance using metrics like accuracy and precision.

5. Data Interpretation & Decision Making:

• Derive insights from the analysis and use them for business decision-making.
• Present findings using reports, dashboards, and visualizations.

This process is widely used in business intelligence, healthcare, and finance for better decision-
making.

b) Differentiate between Stemming and Lemmatization.

Feature Stemming Lemmatization

Reduces words to their root form by Converts words to their base or dictionary
Definition
chopping off suffixes. form using linguistic rules.
Less accurate as it may produce non-real
Accuracy More accurate as it returns valid words.
words.
Slower due to dictionary lookup and
Speed Faster since it uses simple rules.
grammatical analysis.
Example "Running" → "Run", "Studies" → "Studi" "Running" → "Run", "Studies" → "Study"
Suitable for applications where speed is Used when precise word meanings are
Use Case
more important than precision. required.
b) Short Note on Trend Analytics [4 Marks]

Trend Analytics is the process of analyzing data patterns over time to identify trends and make
future predictions. It helps in understanding market shifts and consumer behavior.

Key Aspects of Trend Analytics:

1. Historical Data Analysis:

o Analyzing past data to detect recurring trends.
2. Real-Time Trend Detection:
o Identifying new trends as they emerge, using tools like Google Trends.
3. Predictive Modeling:
o Using machine learning to forecast future trends based on past data.

Examples of Trend Analytics:

• Stock Market Analysis: Predicting stock price movements based on past trends.
• Social Media Monitoring: Identifying trending hashtags and topics.
• E-commerce & Marketing: Understanding customer preferences to improve sales
strategies.

Trend analytics helps businesses in decision-making, market research, and forecasting future
opportunities.

a) What is Prediction? Explain any one regression model in detail.

Prediction is the process of using data and machine learning models to estimate unknown values,
such as future sales, stock prices, or weather conditions.

Linear Regression Model:

Linear Regression is a type of regression model that predicts a continuous outcome based on one
or more independent variables. It finds the best-fitting straight line using the equation:
Y = mX + c (for simple linear regression), where:

• Y = Predicted value
• X = Independent variable
• m = Slope of the line
• c = Intercept

Example: Predicting house prices based on square footage. If larger houses generally cost more, the
model learns this pattern and predicts the price of new houses.
c) Describe Types of Data Analytics.
There are four main types of data analytics:

1. Descriptive Analytics – Summarizes past data to understand what happened.

Example: Sales reports showing total revenue in the last year.
2. Diagnostic Analytics – Explains why something happened by analyzing past trends and
patterns.
Example: Analyzing why sales dropped in a particular month.
3. Predictive Analytics – Uses data and models to forecast future outcomes.
Example: Predicting next month's sales based on historical data.
4. Prescriptive Analytics – Suggests actions to achieve desired outcomes.
Example: Recommending the best marketing strategy to increase sales.

These analytics types help businesses and organizations make better decisions based on data

a) What are Frequent Itemsets & Association Rules? Describe with an example.

• Frequent Itemsets are groups of items that appear together frequently in a dataset. They are
commonly used in market basket analysis to find relationships between products.
• Association Rules are if-then statements that show the relationship between frequent
itemsets. They help in understanding patterns in data.

Example:
In a supermarket, if many customers buy "Milk" and "Bread" together, this forms a frequent itemset.
An association rule can be:
{Milk} → {Bread} (Support: 40%, Confidence: 70%)
This means 40% of transactions contain both items, and when milk is bought, there is a 70% chance
bread is also bought

a) Short Note on Community Detection

Community detection is the process of identifying groups of closely connected nodes within a large
network, such as social media, biological networks, or recommendation systems. These
communities help in understanding relationships, influence, and hidden structures in networks.

Example: In social media, community detection helps identify groups of users with similar
interests, such as sports fans or tech enthusiasts.

Common Methods:

1. Modularity-Based Detection – Finds communities by maximizing modularity (a measure of

network structure).
2. Louvain Algorithm – A fast and efficient method to detect communities in large networks.
3. Label Propagation – Spreads labels through a network to identify clusters.

Community detection is widely used in social media analysis, fraud detection, and recommendation
systems.
b) Explain Apriori Algorithm

The Apriori Algorithm is a data mining algorithm used to find frequent itemsets and association
rules in large datasets. It works based on the principle that:
"If an itemset is frequent, then all of its subsets must also be frequent."

Steps of Apriori Algorithm:

1. Find Frequent Itemsets: Identify items that appear together frequently using a minimum
support threshold.
2. Generate Candidate Itemsets: Combine frequent itemsets to create larger sets.
3. Prune Uncommon Itemsets: Remove itemsets that do not meet the minimum support.
4. Generate Association Rules: Extract rules from frequent itemsets based on confidence and
support.

Example:
In a supermarket, the Apriori algorithm may find the frequent itemset:
{Diaper, Beer} → Support: 30%
This means 30% of transactions contain both items, helping businesses in cross-selling strategies.

c) Short Note on Challenges in Social Media Analytics (SMA)

Social Media Analytics (SMA) involves analyzing data from platforms like Twitter, Facebook, and
Instagram to gain insights. However, several challenges arise:

1. Data Overload – Massive volumes of data make it difficult to process and analyze
meaningful insights.
2. Fake News & Misinformation – Identifying and filtering out false information is
challenging.
3. Privacy Issues – User data must be handled responsibly to comply with regulations like
GDPR.
4. Sentiment Analysis Complexity – Understanding sarcasm, slang, and multiple languages
accurately is difficult.
5. Real-Time Processing – Analyzing social media trends in real time requires high
computational power.

Despite these challenges, SMA is widely used in marketing, politics, and customer sentiment
analysis.
Q4

a) Explain Any Two Types of Data Analytics [4 Marks]

Data analytics is classified into different types based on its purpose and approach. Two important
types are:

1. Descriptive Analytics:

• Purpose: Summarizes past data to understand what happened.

• Example: A company analyzing last year’s sales data to find trends.
• Techniques Used: Reports, dashboards, data visualization.

2. Predictive Analytics:

• Purpose: Uses historical data to make future predictions.

• Example: Weather forecasting using past climate data.
• Techniques Used: Machine learning, statistical models.

These types of analytics help businesses make data-driven decisions.

b) What is Expert Finding? How to Find an Expert? [4 Marks]

What is Expert Finding?

Expert finding is the process of identifying individuals who have deep knowledge and expertise in a
particular field. It is useful in research, organizations, and online communities.

How to Find an Expert?

1. Analyzing Publications & Research Papers – Experts are identified based on their work in
journals, patents, or conferences.
2. Social Media & Professional Networks – Platforms like LinkedIn and ResearchGate help
find domain experts.
3. Enterprise Knowledge Systems – Organizations maintain expert directories based on
employee skills.
4. Reputation-Based Ranking – Online forums (e.g., Stack Overflow) rank users based on
their contributions.

Expert finding is widely used in recruitment, consulting, and collaborative research.

b) Challenges in Social Media Analytics (SMA)

Social Media Analytics (SMA) involves analyzing user interactions, trends, and opinions on
platforms like Facebook, Twitter, and Instagram. However, several challenges arise:

1. Data Overload – Huge amounts of data are generated every second, making it difficult to
process and extract useful insights.
2. Fake News & Misinformation – Identifying and filtering false or misleading content is
challenging.
3. Privacy & Ethical Concerns – Handling personal user data must comply with regulations
like GDPR and ensure user privacy.
4. Sentiment Analysis Complexity – Understanding sarcasm, slang, and emojis accurately is
difficult for AI models.
5. Real-Time Processing – Analyzing and reacting to trends in real time requires powerful
computational resources.
6. Platform Algorithm Changes – Frequent updates in social media algorithms affect the
effectiveness of analytical models.
c) Explain Reinforcement Learning

Reinforcement Learning (RL) is a type of machine learning where an agent learns to make
decisions by interacting with an environment. It receives rewards for good actions and penalties
for bad ones, aiming to maximize long-term rewards.

Key Components:

1. Agent – The learner or decision-maker.

2. Environment – The system in which the agent operates.
3. Actions – Choices the agent can make.
4. Reward – Feedback for the agent’s actions (positive or negative).
5. Policy – The strategy used to decide actions.

Example:
A self-driving car is an RL agent that learns to drive by getting rewards for staying in lanes and
penalties for collisions. Over time, it improves its driving skills.

Applications of RL:

• Gaming AI (e.g., AlphaGo, Chess AI)

• Robotics (e.g., Robot arm learning to pick objects)
• Finance (e.g., Stock trading strategies)
• Healthcare (e.g., Personalized treatment plans)

Reinforcement learning is widely used in AI, automation, and decision-making systems.

a) What is Bag of Words & POS Tagging in NLP?

1. Bag of Words (BoW):

o It is a text representation technique used in Natural Language Processing (NLP).
o It ignores grammar and word order, considering only word frequency in a document.
o Words are converted into a matrix format where each row represents a document and
each column represents a word's occurrence.

Example:

o Two sentences:
1. "I love NLP."
2. "NLP is amazing."
o Bag of Words representation:

I love NLP is amazing

11 1 0 0
00 1 1 1

2. POS (Part of Speech) Tagging:

o It is the process of labeling words in a sentence as nouns, verbs, adjectives, etc.
o Helps in syntactic analysis and meaning extraction in NLP.

Example:

o Sentence: "The cat is sleeping."

o POS tags: The (Det), cat (Noun), is (Verb), sleeping (Verb)

POS tagging is useful for chatbots, search engines, and sentiment analysis.
b) What is Logistic Regression? Explain it with Example.

What is Logistic Regression?

Logistic Regression is a supervised learning algorithm used for binary classification problems,
where the output has only two possible values (e.g., Yes/No, True/False, 0/1). Unlike linear
regression, it uses the sigmoid function to predict probabilities instead of continuous values.

Formula of Logistic Regression:

P(Y=1)=1+e−(b0+b1X1+b2X2+...+bnXn)1

where:

• P(Y=1)P(Y=1)P(Y=1) is the probability of the positive class.

• b0,b1,b2,...b_0, b_1, b_2, ...b0,b1,b2,... are coefficients.
• X1,X2,...X_1, X_2, ...X1,X2,... are input features.

Example of Logistic Regression:

A bank wants to predict whether a customer will default on a loan (Yes/No) based on factors like
income and credit score.

• Input features: Income, Credit Score

• Output: 1 (Default), 0 (No Default)
• The model will assign a probability, e.g., 0.85 → High chance of default, while 0.30 →
Low chance of default.

a) Phases in Natural Language Processing (NLP)

NLP involves several phases to process and understand human language. The key phases are:

1. Lexical Analysis:
o Breaks text into words and sentences (tokenization).
o Identifies parts of speech, root words, etc.
o Example: "Running" → "Run" (stemming).
2. Syntactic Analysis (Parsing):
o Checks the grammatical structure of a sentence.
o Identifies subject, verb, and object.
o Example: "He plays football" is correct, but "He play football" is incorrect.
3. Semantic Analysis:
o Extracts the meaning of words and sentences.
o Detects word relationships and meanings in context.
o Example: "Bank" can mean a financial institution or a riverbank.
4. Discourse Analysis:
o Understands sentences in relation to the previous ones.
o Example: "John went to the store. He bought milk." ("He" refers to John).
5. Pragmatic Analysis:
o Interprets sentences based on real-world knowledge.
o Example: "Can you open the door?" is a request, not a yes/no question.
b) Explain Exploratory Data Analysis (EDA)

Exploratory Data Analysis (EDA) is a process used to analyze datasets to find patterns, trends,
and relationships. It helps in understanding the data before applying machine learning models.

Steps in EDA:

1. Data Collection: Gather data from different sources.

2. Data Cleaning: Handle missing values, duplicates, and incorrect data.
3. Data Visualization: Use graphs like histograms, box plots, and scatter plots to understand
distributions and relationships.
4. Summary Statistics: Compute mean, median, standard deviation, etc., to describe data
characteristics.
5. Feature Selection: Identify important variables for model building.

Example:
Analyzing customer purchase data to find the most popular products and trends before building a
recommendation system.

EDA is crucial for data science, machine learning, and business analytics.

c) Explain the Life Cycle of Social Media Analytics (SMA)

The Social Media Analytics (SMA) Life Cycle consists of steps to analyze data from social media
platforms for insights and decision-making.

1. Data Identification & Collection:

o Gather data from social media (tweets, posts, comments, likes).
o Use APIs or web scraping tools.
2. Data Cleaning & Preprocessing:
o Remove duplicate, irrelevant, or noisy data.
o Handle missing values and standardize formats.
3. Data Analysis & Interpretation:
o Perform sentiment analysis, trend analysis, and topic modeling.
o Identify user behavior and engagement patterns.
4. Data Visualization & Reporting:
o Use graphs, charts, and dashboards to present insights.
o Example: A company may analyze customer feedback to improve products.
5. Decision Making & Action:
o Businesses use insights to improve marketing strategies, customer engagement, and
product recommendations.

Example:
A brand analyzes social media comments to understand customer sentiment and improve its
product.

SMA helps in marketing, brand management, and trend prediction.

Q5
a) Short Note on Linear Regression:

Linear Regression is a statistical method used to find the relationship between a dependent
variable and one or more independent variables. It helps predict outcomes based on input
values. The equation for simple linear regression is:

Y=mX+C

where Y is the dependent variable, X is the independent variable, m is the slope (how much
Y changes with X), and C is the intercept. It is widely used in data analytics for trend
analysis, forecasting, and making predictions.

b) Short Note on Natural Language Processing (NLP):

Natural Language Processing (NLP) is a branch of artificial intelligence that helps computers
understand, interpret, and generate human language. It is used in applications like chatbots,
voice assistants (like Siri, Alexa), translation tools (Google Translate), and sentiment
analysis. NLP involves techniques such as tokenization, stemming, and machine learning
models to process text data efficiently.

c) Short Note on Text Analy�cs:

Text Analytics is the process of analyzing and extracting meaningful insights from large amounts of text
data. It involves techniques like text mining, sentiment analysis, and keyword extraction to understand
patterns, trends, and sentiments in text. Businesses use text analytics for customer feedback analysis, spam
detection, and social media monitoring. It helps in making data-driven decisions by converting unstructured
text into useful information.

a) Define the terms i) Confusion Matrix ii) Accuracy iii) Precision

i) Confusion Matrix:

A confusion matrix is a table used to evaluate the performance of a classification model. It shows
the actual vs. predicted classifications and includes four values:

ii) Accuracy:

Accuracy measures how well a classification model predicts correct results. It is calculated as:

Accuracy=(TP+TN+FP+FN)/(TP+TN)

It shows the percentage of correctly classified cases out of all cases.

iii) Precision:

Precision tells how many of the predicted positive cases are actually positive. It is calculated as:

Precision=(TP+FP)/TP
A higher precision means fewer false positives.
b) What is Machine Learning? Explain its Types.

Machine Learning (ML) is a branch of Artificial Intelligence (AI) that enables computers to learn
from data and make predictions without being explicitly programmed. It is used in applications like
recommendation systems, image recognition, and fraud detection.

Types of Machine Learning:

1. Supervised Learning:
o The model learns from labeled data (input-output pairs).
o Example: Spam email detection (spam or not spam).
2. Unsupervised Learning:
o The model finds patterns in unlabeled data without predefined categories.
o Example: Customer segmentation in marketing.
3. Reinforcement Learning:
o The model learns by trial and error using rewards and penalties.
o Example: Self-driving cars learning to navigate.

a) Short Note on Support Vector Machine (SVM):

Support Vector Machine (SVM) is a supervised machine learning algorithm used for classification and
regression tasks. It works by finding the best boundary (hyperplane) that separates different classes in the
data. SVM uses support vectors (data points closest to the boundary) to define this hyperplane. It can also
handle non-linear data using the kernel trick, which transforms data into a higher dimension for better
separation. SVM is widely used in image classification, text categorization, and medical diagnosis.

b) Life Cycle of Data Analytics:

The Data Analytics life cycle consists of several steps to analyze data and gain insights. The key stages are:

1. Data Collection:
o Gathering raw data from different sources like databases, sensors, or files.
2. Data Cleaning:
o Removing errors, duplicates, and missing values to ensure data quality.
3. Data Exploration:
o Analyzing and summarizing data using visualization and statistical methods.
4. Data Modeling:
o Applying machine learning or statistical models to find patterns and make predictions.
5. Data Interpretation & Visualization:
o Presenting the results using charts, graphs, and reports to help decision-making.
6. Deployment & Monitoring:
o Implementing the model in real-world applications and monitoring its performance.