Stat I CH- IV PPT
Stat I CH- IV PPT
CHAPTER FOUR
4. PROBABILITY THEORY
AND PROBABILITY
DISTRIBUTION
4.1 PROBABILITY THEORY
Probability of an event is a number that
measures the chance, or likelihood, that the
event will occur.
For instance, the probability that your fa-
vorite football team will win its next game
measures the likelihood of a victory.
The probability of an event is always a
number between 0 and 1.
The closer an event’s probability is to 1, the
higher is the likelihood that the event will
occur; the closer the event’s probability is
to 0, the smaller is the likelihood that the
For example, if you believe that the
probability that your favorite football
team will win its next game is 0.95, then
you are almost sure that your team will
win. However, if you believe that the
probability of victory is only 0.10, then
you have very little confidence that your
team will win.
SOME BASIC CONCEPTS
Probability, in common parlance, refers
to the chance of occurrence of an event
or happening.
These concepts are an Experiment, a
A. EXPERIMENT
A random experiment is a mechanism that
produces a definite outcome that cannot be
predicted with certainty.
An outcome of an experiment is some obser-
vation or measurement.
Any action, whether it is the drawing a card
out of a deck of 52 cards, or reading the
temperature, or measurement of a product's
dimension to ascertain quality, or the launch-
ing of a new product in the market, consti-
tute an experiment in the probability theory
terminology.
Cont’d
The experiments in probability theory
have three things in common:
there are one or more outcomes of each
experiment
it is possible to specify the outcomes in
advance
there is uncertainty about the outcomes
A single outcome of an experiment is
called a basic outcome or an elemen-
tary event.
Any particular card drawn from a deck
B. SAMPLE SPACE
The Sample space is the universal
set S pertinent to a given experi-
ment.
It is the set of all possible outcomes
of an experiment.
So each outcome is visualized as a
sample point in the sample space.
The sample spaces for the following experiments are:
Experiment Sample Space
Drawing a Card {all 52 cards in the
deck}
Reading the Tempera- {all numbers in the
ture range of temperatures}
Measurement of a {undersize, outsize,
Product's Dimension right size}
Launching of a New {success, failure}
Product
3. EVENT
An event, in probability theory,
constitutes one or more possible
outcomes of an experiment.
An Event is a subset of a sample
space.
It is a set of basic outcomes.
We say that the event occurs if the
experiment gives rise to a basic
outcome belonging to the event.
For the experiment of drawing a
APPROACHES TO PROBABILITY
THEORY
We often wish to assign probabilities to
sample space outcomes.
This is usually done by using one of
three methods:
The classical method, the relative
frequency method, or the subjective
method.
Regardless of the method used, proba-
bilities must be assigned to the exper-
imental outcomes so that two condi-
tions are met:
1. The probability assigned to each
sample space outcome must be be-
tween 0 and 1 that is, if E repre-
sents a sample space outcome and
if P(E) represents the probability of
this outcome, then 0 ≤ P(E) ≤ 1.
2. The probabilities of all of the sam-
ple space outcomes must sum to 1.
THE CLASSICAL APPROACH
The classical method of assigning probabili-
ties can be used when the sample space out-
comes are equally likely.
For example, consider the experiment of toss-
ing a fair coin. Here, there are two equally
likely sample space outcomes head (H) and
tail (T).
Therefore, logic suggests that the probability
of observing a head, denoted P(H), is 1/2 =
0.5, and that the probability of observing a
tail, denoted P(T), is also 1/2 = 0.5.
Notice that each probability is between 0
and 1. Furthermore, because H and T are
all of the sample space outcomes, P(H) +
P(T) = 1.
In general, if there are N equally likely
sample space outcomes, the probability
assigned to each sample space outcome
is 1/N.
To illustrate this, consider the experiment
of rolling a fair die.
It would seem reasonable to think that
the six sample space outcomes 1, 2, 3, 4,
5, and 6 are equally likely, and thus each
If P(1) denotes the probability that one dot appears
on the upward face of the die, then P(1) = 1/6. Simi-
larly, P(2) = 1/6, P(3) = 1/6, P(4) = 1/6, P(5) = 1/6,
and P(6) = 1/6.
In the Classical Approach, probability of an event is
defined as the relative size of the event with re-
spect to the size of the sample space. The rule we
use in computing probabilities, assuming equal likeli-
hood of all basic outcomes, is as follows:
Probability of the event A:
P (A) = n (A)
N (S)
Where, n (A) = the number of outcomes favorable
to the event A
N (S) = total number of outcomes
Example: 1 A fair coin is tossed
twice.
Find the probabilities of the following
events:
a)getting two heads
b)getting one head and one tail
c)getting at least one head or one
tail
d)getting four heads
THE RELATIVE FREQUENCY APPROACH
The Relative Frequency Approach is used
to compute probability in which there is
only a past data. In the absence of past
data, we have to undertake an experiment.
As per this approach, the probability of
occurrence of an event is given by the ob-
served relative frequency of an event in
a very large number of trials. In other
words, the probability of occurrence of an
event is the ratio of the number of times
the event occurs to the total number of tri-
als.
For example, to estimate the probabil-
ity that a randomly selected consumer
prefers Coca-Cola to all other soft
drinks, we perform an experiment in
which we ask a randomly selected con-
sumer for his or her preference.
There are two possible experimental
outcomes: “prefers Coca- Cola” and
“does not prefer Coca-Cola.” However,
we have no reason to believe that
these experimental outcomes are
equally likely, so we cannot use the
classical method.
We might perform the experiment, say,
1,000 times by surveying 1,000 randomly
selected consumers. Then, if 140 of those
surveyed said that they prefer Coca-Cola,
we would estimate the probability that a
randomly selected consumer prefers Coca-
Cola to all other soft drinks to be 140/1,000
= 0.14.
This is an example of the relative frequency
method of assigning probability. The proba-
bility of the event B:
P (B) = n
N
Where, n = the number of times the
event occurs
Example: 2
A newspaper boy wants to find out the
chances that on any day he will be able to
sell more than 90 copies of The Times of
Ethiopia. From his dairy where he
recorded the daily sales of the last year,
he finds out that out of 365 days, on 75
days he had sold 80 copies, on 144 days
he had sold 85 copies, on 62 days he had
sold 95 copies and on 84 days he had
sold 100 copies of The Times of Ethiopia.
Find out the required probability for the
newspaper boy.
THE SUBJECTIVE APPROACH
In this approach, we try to assess the
probability from our own experiences. We
may bring in any information to assess this.
Therefore the Subjective Approach involves
personal judgment, information, intuition,
and other subjective evaluation criteria.
The area of subjective probability - which
is relatively new, having been first devel-
oped in the 1930s – is somewhat contro-
versial. One person's subjective probability
may very well be different from another
person's subjective probability of the same
Cont’d
We may note here that since the as-
sessment is a purely subjective one, it
will vary from person to person and,
therefore, subjective probability is also
called Personal Probability.
Example: 3
In a certain situation, one might ex-
press the confidence that there are
70:30 chances of a salesman achieving
his sales quote.
Some Elementary Probability Rules
We can often calculate probabilities by
using formulas called probability rules.
We will begin by presenting the simplest
probability rule: the rule of comple-
ments. To start, we define the comple-
ment of an event:
The Rule of Complements defines the
probability of the complement of an event
in terms of the probability of the original
event. Consider event A defined over the
sample space S.
Cont’d
The complement of an event A in a sample space
S, denoted by Ac, is the collection of all outcomes
in S that are not elements of the set A. (see Figure
1)
P (Ac) = 1 - P (A)
Figure 1 Comple-
ment of an event
P ( Bi /A ) = P(A/Bi).P(Bi)
∑ P(A/ Bi).P(Bi)
Cont’d
Suppose there are two urns, marked I and II. Urn I contains 4 red
balls and 6 black balls, and Urn II has 3 red balls and 2 black
balls. Since one of the Urns is to be selected at random for draw-
ing a ball both Urns have equal probability of being selected that
is
P(x1) = p(x2) = ½ where, Urn I be denoted x1 and
Urn II be denoted x2
There are four conditional probabilities from the two outcomes.
Red ball (y1) Black ball (y2)
p (y1/x1) = 4/10 p (y2/x1) = 6/10
p (y1/x2) = 3/5 p (y2/x2) = 2/5
From the conditional probability p (x1/y2) that the ball is selected
belongs to Urn I (x1); given that it is a black ball (y2)
Exercise:
Suppose Urn I contains 4 red, 6 black, 2 white balls; Urn II con-
tains 2 red, 8 black, 4 white balls; and Urn III contains 6 red, 4
black, and 6 white balls. Further assume that two dies are thrown
together. Let Urn selection be based on the sum of die face points
as bellow.
Urn I is selected for drawing a ball if the sum is equal to 5 or less.
Urn II is selected for drawing a ball if the sum is equal to 8 or
more.
Urn III is selected for drawing a ball if the sum is equal to 6 or 7.
a) Find the probability that the ball drawn belongs to Urn I when it is
known that it is a white ball.
b) Find the probability that the ball drawn belongs to Urn II when it
is known that it is a black ball.
c) Find the probability that the ball drawn belongs to Urn III when it
is known that it is a red ball.
4.2 Probability Distribution
INTRODUCTION
In many situations, our interest does not lie in the outcomes of
an experiment as such; we may find it more useful to describe a
particular property or attribute of the outcomes of an experi-
ment in numerical terms.
For example, out of three births; our interest may be in the mat-
ter of the probabilities of the number of boys. Consider the
sample space of 8 equally likely sample points.
GGG GGB GBG BGG
GBB BGB BBG BBB
Now look at the variable “the number of boys out of three
births”. This number varies among sample points in the sample
space and can take values 0,1,2,3, and it is random –given to
chance.
“A random variable is an uncertain quantity whose value depends
onAchance.”
random variable may be…
Discrete if it takes only a countable number of values. For exam-
ple, number of dots on two dice, number of heads in three coin
tossing, number of defective items, number of boys in three births
and so on.
Continuous if it can take on any value in an interval of numbers
(i.e. its possible values are unaccountably infinite). For example,
measured data on heights, weights, temperature, and time and so
on.
A random variable has a probability law - a rule that assigns prob-
abilities to different values of the random variable. This probabil-
ity law - the probability assignment is called the probability distri-
bution of the random variable. We usually denote the random
variable by X.
4.2.1 DISCRETE PROBABILITY DISTRIBUTION
The random variable X denoting “the number of boys out of three
births”, we introduced in the introduction of the lesson, is a discrete
random variable; so it will have a discrete probability distribution.
It is easy to visualize that the random variable X is a function of
sample space. We can see the correspondence of sample points with
the values of the random variable as follows:
GGG GGB GBG BGG
(X=0) (X=1)
GBB BGB BBG BBB
(X=2) (X=3)