Unit 1 - Probability Theory
Unit 1 - Probability Theory
0 .5 1
Probability:
where:
Ei (event) is the ith experimental outcome
and P(Ei) is its probability
Assigning Probabilities
◼ Basic Requirements for Assigning Probabilities
where:
n is the number of experimental outcomes
Assessing Probability
X 31daysin January 31
= =
T 365daysin 2010 365
Example of a priori probability
Consider a standard deck of cards that has 26 red cards
and 26 black cards. The probability of selecting a black
card is
Example of a priori probability
Consider a standard deck of cards that has 26 red cards
and 26 black cards. The probability of selecting a black
card is
X numberof blackcards
Probability of selectigna blackcard = =
T totalnumberof cards
X Numberof blackcards 26
= = = 0.50
T Totalnumberof cards 52
Another example of a priori/ Classical Method
◼ Rolling a Die
If an experiment has n possible outcomes, the
classical method would assign a probability of 1/n
to each outcome.
Number of Number
Polishers Rented of Days
0 4
1 6
2 18
3 10
4 2
Empirical/ Relative Frequency Method (2)
◼ Example: Lucas Tool Rental
Each probability assignment is given by dividing
the frequency (number of days) by the total frequency
(total number of days).
Number of Number
Polishers Rented of Days Probability
0 4 .10
1 6 .15
2 18 .45 4/40
3 10 .25
4 2 .05
40 1.00
Empirical/ Relative Frequency Method
Chap 4-19
Complement of an Event
Sample
Event A Ac Space S
Venn
Diagram
Union of Two Events
Sample
Event A Event B Space S
Intersection of Two Events
Sample
Event A Event B Space S
Intersection of A and B
Addition Law
The addition law provides a way to compute the
probability of the union of two events (event A, or B,
or both A and B occurring).
P(Jan. or Wed.) =?
Chap Chap
4-25 4-25
General Addition Rule Example
Don’t count
the four
Wednesdays
in January
Jan. Not Jan. Total twice!
Wed. 4 48 52
Not Wed. 27 286 313
Chap Chap
4-26 4-26
Mutually Exclusive Events
Sample
Event A Event B Space S
Mutually Exclusive Events
There is no need to
include “- P(A B)”
Conditional Probability
P( A B)
P( A|B) =
P( B)
Using Decision Trees
Multiplication Law
P(A B) = P(B)P(A|B)
Conditional Probability and Conjunction Fallacy
P(A B) = P(A)P(B)
Independent Events and Gambler’s Fallacy
as in our previous example. But it is obvious that events A and B cannot simultaneously
occur, since rolling a 6 means the face is red, and rolling a green face means the number
showing is odd. Therefore
• P(A and B) = 0.
Bayes’ Theorem
P(G|A1) = .98
P(A1 G) = .6370
P(A1) = .65
P(B|A1) = .02 P(A1 B) = .0130
P(G|A2) = .95
P(A2 G) = .3325
P(A2) = .35
P(B|A2) = .05 P(A2 B) = .0175
New Information
◼ Example: Quality of Purchased Parts
Now suppose that the parts from the two suppliers
are used in the firm’s manufacturing process and
that a bad part causes a machine to break down.
What is the probability that the bad part came from
supplier 1 and what is the probability that it came
from supplier 2?
With the information in the probability tree, we
can use Bayes’ theorem to answer these questions.
Bayes’ Theorem
◼ To find the posterior probability that event Ai will
occur given that event B has occurred, we apply
Bayes’ theorem.
P( Ai )P( B| Ai )
P( Ai |B) =
P( A1 )P( B| A1 ) + P( A2 )P( B| A2 ) + ... + P( An )P( B| An )
P( A1 )P( B| A1 )
P( A1 |B) =
P( A1 )P( B| A1 ) + P( A2 )P( B| A2 )
(.65)(.02)
=
(.65)(.02) + (.35)(.05)
= .4262
Bayes’ Theorem: Tabular Approach
◼ Example: Quality of Purchased Parts
• Step 1
Prepare the following three columns:
Column 1 - The mutually exclusive events for
which posterior probabilities are desired.
Column 2 - The prior probabilities for the events.
Column 3 - The conditional probabilities of the
new information given each event.
Bayes’ Theorem: Tabular Approach
◼ Example: Quality of Purchased Parts
• Step 1
(1) (2) (3) (4) (5)
Prior Conditional
Events Probabilities Probabilities
Ai P(Ai) P(B|Ai)
A1 .65 .02
A2 .35 .05
1.00
Bayes’ Theorem: Tabular Approach
◼ Example: Quality of Purchased Parts
• Step 2
Prepare the fourth column:
Column 4
Compute the joint probabilities for each event and
the new information B by using the multiplication
law.
Multiply the prior probabilities in column 2 by the
corresponding conditional probabilities in column 3.
That is, P(Ai I B) = P(Ai) P(B | Ai).
Bayes’ Theorem: Tabular Approach
◼ Example: Quality of Purchased Parts
• Step 2
(1) (2) (3) (4) (5)
Prior Conditional Joint
Events Probabilities Probabilities Probabilities
Ai P(Ai) P(B|Ai) P(Ai I B)
P(B) = 𝑃 𝐴𝑖 𝑃(𝐵|𝐴𝑖)
𝑖=1
In a country, 60% of registered voters are republicans, 30% are democrats, and 10% are
independents. A survey asked these voters about military spending and the results shows
that 40% of republicans, 65% of the democrats, and 55% of the independents opposed it.
What is the probability that a randomly selected voter in this country opposes increased
military spending?
Total Probability Theorem - Example
=
(.14)(.89)
= 0.9826
(.14)(.89) + (.02)(.11)
Probability of getting A