Stat I CH - 4
Stat I CH - 4
1|Page
EVENT
An event, in probability theory, constitutes one or more possible outcomes of an experiment. An
Event is a subset of a sample space. It is a set of basic outcomes. We say that the event occurs if
the experiment gives rise to a basic outcome belonging to the event. For the experiment of
drawing a card, we may obtain different events.
2|Page
THE RELATIVE FREQUENCY APPROACH
The Relative Frequency Approach is used to compute probability in which there is only a past
data. In the absence of past data, we have to undertake an experiment. As per this approach, the
probability of occurrence of an event is given by the observed relative frequency of an event in a
very large number of trials. In other words, the probability of occurrence of an event is the ratio
of the number of times the event occurs to the total number of trials. For example, to estimate the
probability that a randomly selected consumer prefers Coca-Cola to all other soft drinks, we
perform an experiment in which we ask a randomly selected consumer for his or her preference.
There are two possible experimental outcomes: “prefers Coca- Cola” and “does not prefer Coca-
Cola.” However, we have no reason to believe that these experimental outcomes are equally
likely, so we cannot use the classical method. We might perform the experiment, say, 1,000
times by surveying 1,000 randomly selected consumers. Then, if 140 of those surveyed said that
they prefer Coca-Cola, we would estimate the probability that a randomly selected consumer
prefers Coca-Cola to all other soft drinks to be 140/1,000 = 0.14. This is an example of the
relative frequency method of assigning probability. The probability of the event B:
n
P (B) =
N
Where, n = the number of times the event occurs
N = total number of trials
Example: 2
A newspaper boy wants to find out the chances that on any day he will be able to sell more than
90 copies of The Times of Ethiopia. From his dairy where he recorded the daily sales of the last
year, he finds out that out of 365 days, on 75 days he had sold 80 copies, on 144 days he had sold
85 copies, on 62 days he had sold 95 copies and on 84 days he had sold 100 copies of The Times
of Ethiopia. Find out the required probability for the newspaper boy.
3|Page
The Rule of Complements defines the probability of the complement of an event in terms of the
probability of the original event. Consider event A defined over the sample space S. The
complement of an event A in a sample space S, denoted by Ac , is the collection of all outcomes
in S that are not elements of the set A. (see Figure 1)
P (Ac) = 1 - P (A)
As a simple example, if the probability of rain tomorrow is 0.3, then the probability of no rain
tomorrow must be 1 - 0.3 = 0.7. If the probability of drawing a king is 4/52, then the probability
of the drawn card's not being a king is 1 - 4/52 = 48/52.
Example: 4
A card is drawn from a well-shuffled pack of playing cards. Find the probability that the card
drawn is either a club or a king.
4|Page
Figure 3 Two Mutually Exclusive Events A and B
This fact gives us a special rule for unions of mutually exclusive events. Since the probability of
the intersection of the two events is zero, there is no need to subtract P (A∩B) when the
probability of the union of the two events is computed. Therefore,
For mutually exclusive events A and B:
P (A ∪ B) = P (A) + P (B)
This is not really a new rule since we can always use the rule of unions for the union of two
events: If the events happen to be mutually exclusive, we subtract zero as the probability of the
intersection.
Example: 5
A card is drawn from a well-shuffled pack of playing cards. Find the probability that the card
drawn is either a king or a queen.
We can extend the Rule of Unions to three (or more) events. Let A, B, and C be the three events
defined over the sample space S, as shown in Figure 4
Then, the Rule of Unions is
P (A∪B∪C) = P (A) + P (B) + P (C) − P (A∩B) − P (B∩C) − P (A∩C) + P (A∩B ∩C)
When the three events are mutually exclusive (see Figure 5), the Rule of Unions is
P (A∪B∪C) = P (A) + P (B) + P (C)
5|Page
Example: 6
A card is drawn from a well-shuffled pack of playing cards. Find the probability that the card
drawn is
a) either a heart or an honour or king
b) either an ace or a king or a queen.
Conditional Probability
1. The conditional probability of the event A given that the event B has occurred is written
P(A |B) and is defined to be
P (A ∩ B)
P (A / B) =
P(B)
Here we assume that P(B) is greater than 0.
2. The conditional probability of the event B given that the event A has occurred is written
P(B | A) and is defined to be
P (A ∩B)
P (B / A) =
P( A)
Here we assume that P(A) is greater than 0.
Example: 7
For an experiment of throwing a die twice, find the probability:
a) of the event of getting a total of 9, given that the die has shown up points between 4 and 6
(both inclusive)
b) of the event of getting points between 4 and 6 (both inclusive), given that a total of 9 has
already been obtained
6|Page
THE PRODUCT RULE
The Product Rule (also called Multiplication Theorem) allows us to write the probability of the
simultaneous occurrence of two (or more) events.
In the conditional probability rules
P (A ∩B) P (B ∩ A)
P (A / B) = and P (B / A) =
P( B) P( A)
Example: 8
A box contains 10 balls out of which 2 are green, 5 are red and 3 are black. If two balls are
drawn at random, one after the other without replacement, from the box. Find the probabilities
that:
(a) both the balls are of green color
(b) both the balls are of black color
(c) both the balls are of red color
(d) the first ball is red and the second one is black
(e) the first ball is green and the second one is red
Independent Events
Two events are said to be independent of each other if the occurrence or non-occurrence of one
event in any trial does not affect the occurrence of the other event in any trial. Events A and B
are independent of each other if and only if the following three conditions hold:
When A and B are independent (and only when they are independent), we can obtain the
probability of the joint occurrence of A and B (i.e. the probability of their intersection) simply by
multiplying the two separate probabilities. This rule is thus called the Product Rule for
Independent Events.
7|Page
A Counting Rule for Multiple-Step Experiments
If an experiment can be described as a sequence of k steps in which there are n1 possible
outcomes on the first step, n2 possible outcomes on the second step, and so on, then the total
number of experimental outcomes is given by (n1)(n2) . . . (nk).
Example 9: Now suppose the student takes a class quiz consisting of three true–false questions.
Then, there are (n1)(n2)(n3) = (2)(2)(2) = 8 experimental outcomes. If the student is totally
unprepared for the quiz and has to blindly guess the answer to each question, the 8 experimental
outcomes might be considered to be equally likely. Therefore, since only one of these outcomes
corresponds to all three questions being answered correctly, the probability that the student will
answer all three questions correctly is 1/8.
()
n n!
r
= =
15 !
( n−r )!* r ! 12 !* 3 !
=455 ways
8|Page
(22 )∗(131 )=13 ways .
Exercises:
1. Out of 5 Mathematician and 7 Statistician a committee consisting of 2 Mathematician
and 3 Statistician is to be formed. In how many ways this can be done if
a) There is no restriction
b) One particular Statistician should be included
c) Two particular Mathematicians cannot be included on the committee.
2. If 3 books are picked at random from a shelf containing 5 novels, 3 books of poems, and
a dictionary, in how many ways this can be done if
a) There is no restriction.
b) The dictionary is selected?
c) 2 novels and 1 book of poems are selected?
BAYES’ THEOREM
The Bayes’ theorem is useful in revising the original probability estimates as we gain additional
information about the events or outcomes. The prior probabilities when changed in the light of
new information are called revised or posterior probability. Prior probability is the initial
probability based on the present level of information. Posterior probability is a revised
probability based on additional information.
P ( A /Bi ) . P( Bi)
n
P ( Bi /A ) =
∑ ❑ P ( A /Bi ) . P ( Bi )
i=1
Suppose there are two urns, marked I and II. Urn I contains 4 red balls and 6 black balls, and Urn
II has 3 red balls and 2 black balls. Since one of the Urns is to be selected at random for drawing
a ball both Urns have equal probability of being selected that is
P(x1) = p(x2) = ½ where, Urn I be denoted x1 and Urn II be denoted x2
There are four conditional probabilities from the two outcomes.
9|Page
Urn III is selected for drawing a ball if the sum is equal to 6 or 7.
a) Find the probability that the ball drawn belongs to Urn I when it is known that it is a
white ball.
b) Find the probability that the ball drawn belongs to Urn II when it is known that it is a
black ball.
c) Find the probability that the ball drawn belongs to Urn III when it is known that it is a red
ball.
4.2 PROBABILITY DISTRIBUTION
INTRODUCTION
In many situations, our interest does not lie in the outcomes of an experiment as such; we may
find it more useful to describe a particular property or attribute of the outcomes of an experiment
in numerical terms. For example, out of three births; our interest may be in the matter of the
probabilities of the number of boys. Consider the sample space of 8 equally likely sample points.
GGG GGB GBG BGG
GBB BGB BBG BBB
Now look at the variable “the number of boys out of three births”. This number varies among
sample points in the sample space and can take values 0,1,2,3, and it is random –given to chance.
The correspondence between sample points and the value of the random variable allows us to
determine the probability distribution of X as follows:
P(X=0) = 1/8 since one out of 8 equally likely points leads to X = 0
10 | P a g e
P(X=1) = 3/8 since three out of 8 equally likely points leads to X = 1
P(X=2) = 3/8 since three out of 8 equally likely points leads to X = 2
P(X=3) = 1/8 since one out of 8 equally likely points leads to X = 3
The above probability statement constitute the probability distribution of the random variable X
= number of boys in three births. We may appreciate how this probability law is obtained simply
by associating values of X with sets in the sample space. (For example, the set GGB, GBG, BGG
leads to X = 1). We may write down the probability distribution of X in table format (see Table
4-1)
Table 4-1 Probability Distribution of the Number of Boys out of Three Births
No. of Boys X Probability P(X)
0 1/8
1 3/8
2 3/8
3 1/8
The probability distribution of a discrete random variable X must satisfy the following two
conditions:
These conditions must hold because the P(X = x) values are probabilities. The first condition
specifies that all probabilities must be greater than or equal to zero, as we know from Lesson 4.1
For the second condition, we note that for each value x, P(x) = P(X = x) is the probability of the
event that the random variable equals x. Since by definition all x means all the values the random
variable X may take, and since X may take on only one value at a time, the occurrences of these
values are mutually exclusive events, and one of them must take place.
Therefore, the sum of all the probabilities P(X = x) must be 1.00.
For example, to find the probability of at most two boys out of three births, we have
F ( X =2 )=P ( X ≤ 2 )= ∑ p (i)
all i≤ 2
11 | P a g e
= P(x=0) + P(x = 1) + P(x = 2)
= 1/3 + 3/8 + 3/8
= 7/8
Discrete probability has three main classifications.
1. Binomial distribution
2. Hyper geometric distribution
3. Poisson distribution
1. Binomial Distribution
Binomial Distribution: It deals with populations whose elements or outcomes can be divided
into two categories with reference to the presence or absence of a particular attribute or
characteristic. for example answers to an exercise may be correct or incorrect, a product may be
defective or non defective etc...
Characteristics of a binomial distribution
It consist of n trials and each trial has only two outcomes, either of which may be
designated as a success or failures.
The probability of a success p remains the same in all trials. Consequently, the
probability of a failure q = (1- p) also remains the same in all trials.
The number of successes in n trials can be expressed by the random variable X that
assumes discrete values from 0 to n.
Repeated trials are independent since no definite pattern is involved in the occurrence of
either of the two outcomes in successive trials.
12 | P a g e
Example 12: In the throw of a fair die, point 5 coming up is considered a success with
probability = 1/6. The probability of not getting point 5, a failure is q (1-p) = 5/6. If the die is
throw 4 times. Find all the binomial probability?
Example 13: Suppose 60% of Management students pass Statistics for Management I final
examination and there were a total of 50 students, find
a) the expected value of the number of success
b) standard deviation and variance
K N −K N −n
δ = n( ¿( ¿( ¿
2
N N N−1
Where; N = the size of the population
K = the number of successes in the population
n = the size of the sample or the number of trials
x = the number of success of interest, it may be 0, 1, 2, 3,..........n
Example 14: Assume that an Urn contains 6 red balls and 4 black balls. If a sample of 4 balls is
drawn from the Urn without replacement. find:
a) the probability of getting 2 successes out of 6 balls
b) the probability of all values of hyper geometric variables
c) the mean and the variance of hyper geometric distribution
Example 15: Suppose 50 play stations were manufactured during the week. Forty operated
perfectly and ten had at least one defect. A sample of 5 is selected at random without
replacement. What is the probability that 4 of the 5 will operate perfectly?
3. Poisson Distribution
Poisson Distribution: refers to the problem situation in which occurrence an event and counting
the number of times the event occurs during the specified time intervals.
It is the number of occurrences of an event and not the non- occurrences in a given
situations that is of interest.
the events must be random and independent of each other.
13 | P a g e
x −μ
μ e
Poisson Distribution = p(x) =
x!
Where, μ=¿is the average number of occurrence(successes) per unit of time
e = is the base of natural logarithms and is equal to 2.718282
x = is the number of occurrence (success)
Example 16: Assume that on an average 3 persons enter the bank for service every 10 minutes.
What is the probability that exactly 5 customers will enter the bank in a given 10 minutes period,
assuming that the process can be described by the Poisson distribution.
Example 17: Customers arrive at a photocopying machine at an average rate of two every 10
minutes. the number of arrival is distributed according to a Poisson distribution. What is the
probability that:
a) there will be no arrivals during any period of 10 minutes.
b) there will be exactly one arrival during this time period.
c) there will be more than two arrivals during this period
x−μ
Z= δ or x = μ ± zδ
Z score is positive for values which are to the right of the mean and negative to the left of the
mean.
Three different ways of measuring the area under the normal curve
1. About 68% of the area under the normal curve is within ±1 standard deviation from the
mean.
14 | P a g e
2. About 95.45% of the area under the normal curve is within ±2 standard deviation from
the mean.
3. About 99.75% of the area under the normal curve is within ±3 standard deviation from
the mean.
Exercise: The final examination scores in Statistics are normally distributed with an average
score of 70 and variance of 25.
a) If the lowest passing grade is 58, what percentage of the class is failing?
b) If the professor gives the grades on a curve and everybody getting 82 or above gets a
grade of A, then what percentage of students get A grade?
c) If the highest 80% of the class are to pass the course, what is the lowest passing score?
d) What should the score be so that only 15% of the students get a score higher than this?
15 | P a g e