Practical Assignment 1

Name:
CRN No:
Course: 310302: Computational Programming Laboratory
Instructor: Prof.

Title: Computation of Statistical Estimators and Graphical Representation of Sample

Distribution

Date of Completion:

Assignment Objectives:

● To compute the estimators of statistical measures such as mean, variance, and standard
deviation.
● To calculate covariance, correlation, and standard error for a given dataset.
● To visualize the distribution of samples graphically.
● To understand the relationship between different statistical measures through
computation.

Problem Statement:
Compute Estimators of the main statistical measures like Mean, Variance, Standard Deviation,
Covariance, Correlation and Standard error with respect to any example. Display graphically the
distribution of samples.

Software and Hardware Requirements:

Software Requirements:

● Python (with libraries like NumPy, Pandas, Matplotlib)

● R (optional for statistical computation)
● Microsoft Excel (optional)

Hardware Requirements:

● A computer or laptop with at least 4GB RAM

● An internet connection for software installation and data resources (if needed)

Theory:

1. Mean
The mean, often referred to as the average, is one of the most fundamental concepts in
statistics. It represents the central value of a dataset and is calculated by summing all data
points and dividing by the number of points. The formula is:

n
1
Mean = n ∑ X i
i=1

Where:

● n is the number of observations.

● Xi is each data point.

The mean gives a general idea of where the center of the data is but may not always represent
the dataset well if there are extreme values (outliers).

2. Variance

Variance is a measure of the spread or dispersion within a dataset. It tells us how much the
individual data points deviate from the mean. A higher variance indicates that the data points
are more spread out, while a lower variance means they are closer to the mean. The formula
for variance differs slightly between population and sample datasets:

For Population Variance:

1 N
σ 2
= N ∑ ❑(Xi − μ)2
i=1

For Sample Variance:

1 N
s 2
= n−1 ∑ ❑(Xi − X )2
i=1

Where:
● N is the total number of data points in the population.
● n is the number of data points in the sample.
● Xi is each data point.
● μ is the population mean, and X is the sample mean.

Variance gives a sense of how widely spread the data is around the mean.

3. Standard Deviation

Standard deviation is a widely used measure of the dispersion or spread of a dataset. It tells
us how much the individual data points deviate from the mean, but unlike variance, it is
expressed in the same units as the data itself, making it easier to interpret. It is simply the
square root of the variance. The formula differs slightly for population and sample datasets:

For Population Standard Deviation:

σ = √❑

For Sample Standard Deviation:

s = √❑

Where:

● N is the total number of data points in the population.

● n is the number of data points in the sample.
● Xi is each data point.
● μ is the population mean, and X is the sample mean.

Standard deviation provides an intuitive measure of variability in a dataset. A low standard

deviation means the data points are close to the mean, while a high standard deviation
indicates that the data points are spread out over a wider range. It’s especially useful for
comparing the spread of different datasets.

4. Covariance
Covariance is a statistical measure that indicates the direction of the linear relationship
between two variables. It tells us whether the variables tend to increase or decrease together.
If the covariance is positive, it means that as one variable increases, the other tends to
increase as well. Conversely, a negative covariance indicates that as one variable increases,
the other tends to decrease. However, covariance does not provide information about the
strength of this relationship.

Formula for Covariance:

n
1
Cov(X,Y) = ∑ (X − X )(Y i−Y )
n i=1 i

Where:

● n is the number of data points.

● Xi and Yi are individual data points of variables X and Y.
● X and Y are the means of X and Y, respectively.

Covariance provides insight into the joint variability of two variables. If the covariance is
zero, it implies that there is no linear relationship between the variables. While covariance
indicates direction, its magnitude depends on the scale of the variables, which can make
interpretation difficult.

5. Correlation

Correlation is a statistical measure that expresses the strength and direction of a linear
relationship between two variables. Unlike covariance, which only shows direction,
correlation standardizes the relationship, allowing for easier comparison between different
datasets. The most common type of correlation is Pearson’s correlation coefficient, which
ranges from -1 to 1. A value of 1 indicates a perfect positive relationship, -1 indicates a
perfect negative relationship, and 0 means no linear relationship.

Formula for Pearson’s Correlation Coefficient:

 Cov (X , Y )
r=
σ X σY

Where:

● Cov(X,Y) is the covariance between variables X and Y.

● σX and σY are the standard deviations of X and Y, respectively.

Correlation is unitless, making it easier to interpret than covariance. It provides both the
strength and direction of the relationship. A correlation close to 1 or -1 indicates a strong
relationship, while a value near 0 indicates a weak or no linear relationship.

6. Standard Error

The standard error (SE) measures the accuracy with which a sample mean represents the
population mean. It quantifies how much the sample mean is expected to vary from sample to
sample if you repeatedly draw random samples from the population. A smaller standard error
indicates that the sample mean is a more precise estimate of the true population mean. The
standard error decreases as the sample size increases.

Formula for Standard Error of the Mean:

s
SE = √❑

Where:

● s is the sample standard deviation.

● n is the number of observations in the sample.

Standard error is crucial in inferential statistics, as it helps in constructing confidence

intervals and conducting hypothesis tests. It gives an indication of how far the sample mean
is likely to be from the population mean. A larger sample size leads to a smaller standard
error, implying a more reliable estimate of the population parameter.
Implementation:

Example:

X 2 8 18 20 28 30

Y 5 12 18 23 45 50

Calculation of Mean:
2+ 8+18+20+28+ 30
Mean for X = = 17.667
6
5+12+18+23+ 45+50
Mean for Y = = 25.5
6

Calculation of Variance:
Variance for X = ¿ ¿

Variance for X(sX2) = 100.555555667

Variance for Y(sY2) = ¿ ¿

Variance for Y = 274.25

Calculation of Standard Deviation:

s = √❑
sX = 10.0277393099
sY = 16.5604951617

Calculation of Covariance:
 Cov(X, Y) = (⅙) [(2 – 17.67)(5 – 25.5) + (8 – 17.67)(12 – 25.5) + (18 – 17.67)(18 – 25.5) +
(20 – 17.67)(23 – 25.5) + (28 – 17.67)(45 – 25.5) + (30 – 17.67)(50 – 25.5)]
Cov(X, Y) = 157.83

Calculation of Correlation:
ρ (X,Y) = Cov (X,Y) / sX.sY
ρ (X,Y) = 157.83 / 166.064328324
ρ (X,Y) = 0.95041482775

Calculation of Standard error:

s
Std Error =
√❑
10.0277393099
Std ErrorX = = 4.09380743048
√❑
16.5604951617
Std ErrorY = = 6.760793839
√❑

Code:
import matplotlib.pyplot as plt
import numpy as np
from scipy.stats import norm

x = [2,8,18,20,28,30]
y = [5,12,18,23,45,50]

mean_x = np.mean(x)
print(mean_x)
mean_y = np.mean(y)

#Line Graph
# plt.plot(x,y)
# plt.xlabel('X Axis')
# plt.ylabel('Y Axis')
# plt.title('First graph', fontdict={'color':'blue'})
# plt.show()
#Scatter Plot
# plt.scatter(x, y, color='blue')
# plt.axhline(mean_y, color='red', linestyle='--', label=f'Mean Y:
{mean_y}')
# plt.axvline(mean_x, color='green', linestyle='--', label=f'Mean X:
{mean_x}')
# plt.title('Scatter Plot of Sample Data')
# plt.xlabel('X values')
# plt.ylabel('Y values')
# plt.legend()
# plt.show()

#Line Plot
plt.plot(x, y, marker='o', linestyle='-', color='green')
plt.title('Line Plot of Sample Data')
plt.xlabel('X values')
plt.ylabel('Y values')
plt.show()

#Histogram
# plt.hist(x, bins=5, color='orange', edgecolor='black')
# plt.title('Histogram of Sample Data')
# plt.xlabel('X values')
# plt.ylabel('Frequency')
# plt.show()

# Box plot
plt.boxplot([x, y], labels=['X', 'Y'])
plt.title('Box Plot of Sample Data')
plt.ylabel('Values')
plt.show()

std_x = np.std(x)
std_y = np.std(y)

# Scatter plot with standard deviation bands

plt.scatter(x, y, color='blue')
plt.axhline(mean_y, color='red', linestyle='--', label=f'Mean Y: {mean_y}')
plt.axhline(mean_y + std_y, color='purple', linestyle=':', label=f'Y + 1 Std
Dev: {mean_y + std_y}')
plt.axhline(mean_y - std_y, color='purple', linestyle=':', label=f'Y - 1 Std
Dev: {mean_y - std_y}')
plt.title('Scatter Plot with Standard Deviation Bands')
plt.xlabel('X values')
plt.ylabel('Y values')
plt.legend()
plt.show()
#
----------------------------------------------------------------------------
--

# Create histogram of X
plt.hist(x, bins=5, edgecolor='black',density=True, alpha=0.6, color='g')

# Plot normal distribution

xmin, xmax = plt.xlim()
x_range = np.linspace(xmin, xmax, 100)
p = norm.pdf(x_range, mean_x, std_x)
plt.plot(x_range, p, 'k', linewidth=2)
plt.title('Histogram and Normal Distribution of X')
plt.xlabel('X values')
plt.ylabel('Density')
plt.show()

#
----------------------------------------------------------------------------
--

# Line plot with error bars using standard deviation

plt.errorbar(x, y, yerr=std_y, fmt='-o', color='blue', ecolor='orange',
capsize=5)
plt.title('Line Plot with Error Bars (Std Dev)')
plt.xlabel('X values')
plt.ylabel('Y values')
plt.show()

#
----------------------------------------------------------------------------
--

# Calculate covariance
cov_matrix = np.cov(x, y)
cov_xy = cov_matrix[0, 1] # Covariance between x and y

# Scatter plot
plt.scatter(x, y, color='blue')
plt.title(f'Scatter Plot with Covariance: {cov_xy:.2f}')
plt.xlabel('X values')
plt.ylabel('Y values')
plt.show()

# Print covariance value

print(f'Covariance between x and y: {cov_xy}')
#
----------------------------------------------------------------------------
--

# Calculate correlation
correlation_matrix = np.corrcoef(x, y)
corr_xy = correlation_matrix[0, 1] # Correlation between x and y

# Scatter plot
plt.scatter(x, y, color='green')
plt.title(f'Scatter Plot with Correlation: {corr_xy:.2f}')
plt.xlabel('X values')
plt.ylabel('Y values')
plt.show()

# Print correlation value

print(f'Correlation between x and y: {corr_xy}')

#
----------------------------------------------------------------------------
--

# Calculate standard error

def standard_error(data):
return np.std(data, ddof=1) / np.sqrt(len(data))

se_x = standard_error(x)
se_y = standard_error(y)

# Plot with error bars for SE

plt.errorbar(range(len(x)), x, yerr=se_x, fmt='o', label='X values (SE)',
color='blue', capsize=5)
plt.errorbar(range(len(y)), y, yerr=se_y, fmt='o', label='Y values (SE)',
color='green', capsize=5)

plt.title('Standard Error Visualization for X and Y')

plt.xlabel('Index')
plt.ylabel('Values')
plt.legend()
plt.show()

print(f'Standard Error for X: {se_x:.2f}')

print(f'Standard Error for Y: {se_y:.2f}')
Conclusion:
In this assignment, we computed key statistical measures like mean, variance, standard deviation,
covariance, and correlation, offering a deeper understanding of data distribution. Visualizing the
data through various plots highlighted relationships between variables and their dispersion.
These insights enhance our ability to interpret data trends, variability, and overall behavior
effectively.