Scribd
Upload
149 views

Bayes Theorem

Bayes' theorem provides a way to calculate conditional probabilities based on known prior probabilities. It can be used when a sample space is partitioned into mutually exclusive events and the goal is to calculate the probability of one event given that another event occurred. The theorem turns the conditional probabilities around to relate the probability of the original event given the occurring event. Bayes' theorem allows calculating a "reverse conditional probability" which can be applied when investigating potential causes of defects or determining probabilities based on additional information.

Uploaded by

Muhammad Khiruzzaman
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
149 views

Bayes Theorem

Bayes' theorem provides a way to calculate conditional probabilities based on known prior probabilities. It can be used when a sample space is partitioned into mutually exclusive events and the goal is to calculate the probability of one event given that another event occurred. The theorem turns the conditional probabilities around to relate the probability of the original event given the occurring event. Bayes' theorem allows calculating a "reverse conditional probability" which can be applied when investigating potential causes of defects or determining probabilities based on additional information.

Uploaded by

Muhammad Khiruzzaman
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

Bayes Theorem

Let A 1 , A 2 , , A n be a mutually exclusive events that together form the sample space S. Let B
be any event from the same sample space, such that P(B) 0. Then,

P( Ak B)
P ( A k|B =
P ( A 1 B ) + P ( A2 B ) ++ P( A n B)

[note : invoking the fact that P ( A k B )=P ( Ak ) P ( B| A k ]

Bayes theorem can also be expressed as:

P ( A k ) P ( B| A k
P ( A1 ) P ( B| A 1
P ( A k|B = + P ( A2 ) P ( B| A 2 + + P ( A n ) P ( B| A n

When we need to apply Bayes Theorem?


We should consider Bayes Theorem when the following conditions exist:
The sample space is partitioned into a set of mutually exclusive events {A1, A2, ..., An},
Within the sample space, there exists an event B, for which P(B) 0.
The analytical goal is to compute a conditional probability of the form: P ( A k|B .
Know at least one of the two sets of probabilities described below:
P ( A k B ) for each Ak

P ( A k )P ( B| A k for each Ak .

Example 1
In Orange Country, 51% of the adults are males. One adult is randomly selected for a survey
involving credit card usage.
(a) Find the prior probability that the selected person is a female.
0.49

(b) It is later learned that the selected survey subject was smokinng a cigar. Also, 9.5% of
males smoke cigars, whereas 1.7% of females smoke cigars (based on data from the
Substance Abuse and Mental Health Services Administration). Use this additional
information to find the probability that the selected subject is a female.

M = male M = female
C = cigar smoker C = not a cigar smoker

From the information given in part b, we know that


P ( M )= 0.51 P ( C M ) = 0.095
P ( M) = 0.49 P ( C M) = 0.017
To find the selected subject is a female,

P ( M C ) = P ( M ) P ( C M )
[ P ( M ) P ( C M ) + P ( M ) P ( C M ) ]

= 0.49 0.017

( 0.49 0.017 ) + ( 0.51 0.095 )

= 0.147

http://stattrek.com/probability/bayes-theorem.aspx
Example

A desk lamp produced by The Luminar Company was found to be defective (D). There are three
factories (A, B, C) where such desk lamps are manufactured. A Quality Control Manager (QCM) is
responsible for investigating the source of found defects. This is what the QCM knows about the
company's desk lamp production and the possible source of defects:

Factory % of total production Probability of defective lamps

A 0.30 = P(A) 0.020 = P(D | A)

B 0.35 = P(B) 0.010 = P(D | B)

C 0.35 = P(C) 0.015 = P(D | C)

The QCM would like to answer the following question: If a randomly selected lamp is defective,
what is the probability that the lamp was manufactured in factory A, factory B and factory C?

Solution :

For factory A

P( A D) P(D A) P( A)
P(A|D) = =
P( D) P( D)
P( DA ) P( A)
= P D A (D B)( D C )
P( D A) P( A)
= P D A P ( A ) + P ( D|B )P ( B )+ P ( D|C )P(C )

( 0.02 )(0.3)
= ( 0.02 )( 0.3 ) + ( 0.01 ) ( 0.35 ) +(0.015)(0.35)

0.006
= 0.01475

=0.407

So, for factory B


P( B D) P( DB) P(B)
P(B|D)= =
P(D) P(D)
(0.01)(0.35)
= 0.01475
=0.237
For factory C
P( C D) P(DC) P(C)
P(C|D) = =
P ( D) P (D)
(0.015)(0.35)
= 0.01475
= 0.356

Note that in each case we effectively turned what we knew upside down on its head to find out what
we really wanted to know! We wanted to find P(A | D), but we knew P(D | A). We wanted to find
P(B | D), but we knew P(D | B). We wanted to find P(C | D), but we knew P(D | C). It is for this
reason that I like to say that we are interested in finding "reverse conditional probabilities" when we
solve such problems.

The probabilities P(A), P(B) and P(C) are often referred to as prior probabilities, because they are
the probabilities of events A, B, and C that we know prior to obtaining any additional information.
The conditional probabilities P(A | D), P(B | D), and P(C | D) are often referred to as posterior
probabilities, because they are the probabilities of the events after we have obtained additional
information.

As a result of our work, we determined:

P(C | D) = 0.356

P(B | D) = 0.237

P(A | D) = 0.407

Calculated posterior probabilities should make intuitive sense, as they do here. For example, the
probability that the randomly selected desk lamp was manufactured in Factory C has increased, that
is, P(C | D) > P(C), because Factory C generates the greatest proportion of defective lamps (P(D |
C) = 0.015). And, the probability that the randomly selected desk lamp was manufactured in
Factory B has decreased, that is, P(B | D) < P(B), because Factory B generates the smallest
proportion of defective lamps (P(D | B) = 0.01). It is, of course, always a good practice to make sure
that your calculated answers make sense.

Let's now go and generalize the kind of calculation we made here in this defective lamp example ....
in doing so, we summarize what is called Bayes' Theorem.

You might also like