University of Science, VNU-HCM

Faculty of Information Technology

Môn
Introduction toCơ SởScience
Data Trí Tuệ Nhân Tạo
Course

Basic Statistics

Le Ngoc Thanh
[email protected]
Department of Computer Science

Ho Chi Minh City

Contents
◎ Samples and Sampling
◎ Variables and Research Design
◎ Distribution and Central Tendency

2
Population vs. Sample
◎ What is the average income of citizens in Ho Chi Minh City?
○ Get a list of all citizens in HCM City and find out the income, so on…
○ Pros/Cons?
○ Is there any other ways better?

3
Population vs. Sample
◎ A population is an individual or group that represents all the members of a
certain group or category of interest.
◎ A sample is a subset drawn from the larger population.
○ Randomly select a subset is known as a random sample.

4
Quiz. Which is population and sample?
Mr.Thanh wanted to know the average height of the students in
his data science class this term. He collects height of each
student and then calculate on them.
◎ Which type of this collection? (population/sample)

5
Quiz. Which is population and sample?
Lucio wants to know whether the food he serves in his restaurant is
within a safe range of temperatures. He randomly selects 70 entrees
and measures their temperatures just before he serves them to his
customers.
A. The population is all of the hot entrees Lucio serves; the sample is
the entrees that are a safe temperature.
B. The population is the 70 selected entrees; the sample is the
entrees that are a safe temperature.
C. The population is all of the entrees Lucio serves; the sample is
the 70 selected entrees.
6
Population vs. Sample
◎ A population…
○ Parameters are numerical descriptions of population characteristics.
◎ A sample ...
○ Statistics are numerical descriptions from sample data.

7
Descriptive vs Inferential Statistics
◎ Which kind of statistics for following scenarios?
1. The average weekly income for all students in our class is $405
2. The average weekly income for a sample of 450 college students is $325.
3. A recent survey of a sample of 450 college students reported that the
average weekly income for students is $325.

8
Descriptive vs Inferential Statistics
◎ Scenario:
In a recent study, volunteers who had less than 6 hours for sleep were four
times more likely to answer incorrectly on a science test than were
participants who had at least 8 hours of sleep.
◎ Decide which part is a the descriptive statistic and what
conclusion might be drawn using inferential statistics.

9
What if …?
◎ What if the sample is not truly representative of the
population?
○ We cannot be confident that conclusions based on our sample data will
apply to the larger population.
è Sampling Issues

10
Sampling
◎ Ways to select samples:
○ Random sampling: the most useful, but also the most difficult
◉ Random means that every member of a defined population has an

equal chance of being selected into a sample.

◉ Unbiased or biased sampling?

11
Sampling
◎ Ways to select samples:
○ Representative sampling: selects cases so that they will match the larger
population on specific characteristics.
○ Unbiased or biased sampling?

12
Sampling
◎ If you want to conduct a study examining the average annual income of
adults in San Francisco, how to random sample or representative sample?
○ This population includes a number of subgroups (e.g., different ethnic and racial groups, men and
women, retired adults, disabled adults, parents, single adults, etc.).
○ These different subgroups may be expected to have different incomes.

13
Example
◎ Identify color of leaves in September with some following
ways. Which is biased or unbiased sampling?
○ 100 fallen leaves collected from the ground
○ 100 leaves on tree branches
○ 50 fallen leaves and 50 leaves on branches
○ 50 fallen oak leaves and 50 oak leaves on branches

14
Practical examples about sampling
◎ To test for pollution levels in the ocean of Southern California,
researchers took a sample of water and test it. If the pollution levels are
too high in the sample, the beach is declared unsafe and is closed.
○ How about this process?

15
Practical examples about sampling influences results
◎ (Doshi, 2015) For decades, doctors and medical researchers considered
heart disease to be a problem only for men.
◎ Reason:
○ Doctors were less likely to order testing for heart disease for their female patients than their male
patients.
○ The symptoms of heart disease and cardiac failure among women, which are often different from
those of men, were not understood.

16
Other views about sampling
◎ Probability Sampling Techniques:
○ Random sampling
○ Systematic sampling: select members of the population at a
regular interval.
○ Stratified sampling: select specific proportions of individuals
from various subpopulations (strata).

◎ Non-probability Sampling Techniques:

○ Convenience sampling: select members which is close to hand.
○ Snowball sampling: participants recruit other participants for a test.
○ Quota sampling: decide quotas so that the samples can be useful in collecting data

17
Variable and constant
◎ A variable is pretty much anything that can be codified and
have more than a single value.
○ Example: income, gender, age, height, etc.
◎ A constant has only a single score.
○ Example: male, female, 25, etc.

18
Types of variables
◎ Types of variables include qualitative (nominal, ordinal
categorical) and quantitative (discrete, continuous).

19
Scales of measurement
◎ Qualitative variables has 4 scales: nominal, ordinal, interval,
and ratio.

20
Independent vs dependent variables
◎ The independent variable is the variable the experimenter
manipulates or changes, and is assumed to have a direct
effect on the dependent variable.

21
Research Design
◎ Some research designs:
○ Experimental design: divides the cases in the sample into different groups
and then compares the groups on one or more variables of interest.
○ Quasi-experimental research design: a experiment occurs outside of the
lab, in a naturally occurring setting.
○ Correlational research designs: participants are not usually randomly
assigned to groups, the researcher typically does not actually manipulate
anything, the researcher simply collects data on several variables and
then conducts some statistical analyses to determine how strongly
different variables are related to each other.

22
After collect data
◎ Whenever you collect data, you end up with a group of
values/scores on one or more variables.
◎ What do you do next?
○ Preprocessing
○ …

23
Distribution
◎ A distribution is simply a collection of data, or scores, on a
variable which are arranged in order from smallest to largest and
then they can be presented graphically.

24
Distribution Types
◎ There are many distribution types:
○ Nomal distribution
○ 𝑡 distribution
○ 𝐹 distribution
○ chi-square distribution
○ …

25
Distribution characteristics
◎ Some distribution characteristics includes:
○ Shape
○ How spread out the value are (dispersion)
○ max, min
○ …
◎ However, interested characteristics are central tendency and
variability.
○ Central tendency: mean, median, and mode.
○ Variability: range, variance, and standard deviation.

26
Mean
◎ Mean is the arithmetic average of a distribution of values.
○ Calculating the mean involves adding, or summing, all of the values in a distribution and
dividing by the number of values.

𝑋: 86 90 95 100 100 100 110 110 115

120
∑ 𝑋 = 86 + 90 + 95 + 100 + 100 + 100 +
110 + 110 + 115 + 120 = 1026

1026/10 = 102.6 27
Median
◎ The median is the score in the distribution that marks the 50th
percentile.
○ 50 percent of the scores in the distribution fall above the median and
50 percent fall below it.

𝑋: 86 90 95 100 100 100 110 110 115

120
Because two scores in the middle:
Median = (100 + 100)/2 = 100

28
Median
◎ To find the median (P50 and Mdn)
of a distribution:
○ Arrange all of the scores in the distribution in
order, from smallest to largest.
○ Find the middle score in the distribution if there
is an odd number.
○ If there is an even number of scores in the
distribution, the median is the average of the
two scores in the middle of the distribution

29
Mode
◎ The mode is simply the category in the distribution that has
the highest number of scores, or the highest frequency.

30
Mode
◎ No Mode
◎ Single Mode
◎ Multimodal: if a distribution has more than one category with
the most common score, the distribution has multiple modes.
○ BiModal

31
Skewed Distribution
◎ If one tail is longer than another, the distribution is skewed.
○ These distributions are sometimes called asymmetric or asymmetrical
distributions.

32
Outliers
◎ Distributions have a few scores that are very far away from
the mean, they are called outliers.
○ They can have a dramatic effect on the mean of the distribution.
○ When most of the outliers are at one side of a distribution, they pull the
mean toward that end of the distribution.

33
Outliers

81.66 vs 74.98
79.34 vs 77.46

34
Range
◎ The range is the difference between the largest score (the
maximum value) and the smallest score (the minimum value) of a
distribution.

35
Interquartile Range
◎ The interquartile range (IQR) is the
difference between the score that marks
the 75th percentile (the third quartile)
and the score that marks the 25th
percentile (the first quartile).

36
Variance
◎ The variance provides a statistical average of the amount of
dispersion in a distribution of scores.

37
Standard Deviation
◎ A standard deviation is the typical, or average, deviation
between individual scores in a distribution and the mean for
the distribution.

38
Variance and Standard Deviation in Population and Sample

39
Effect of sample size on Standard Deviation

40
Boxplot

41
42