Standard Discrete Probability Distribution
Standard Discrete Probability Distribution
Chapter
Standard Discrete Probability
Distributions : Finite Sample Space
lacob Bernoulli (1654-1705) was a mathematician born
in Switzerland. Bernoulli discovered the constant 'e' by
studying a question about compound interest. Jacob
Bernoulli's most original work was published eight years
after his death. The work is still a work of the greatest
significance in the theory of probability. Many examples
are given on how much one would expect to win playing
various games of chance. The term Bernoulli trial resulted
from this work. Bernouli distribution is named after Jacob
Bernoulli.
Jacob Bernoulli
Contents
6.1 Introduction
6.2 Degenerate Distribution (One Point Distribution)
6.3 Discrete Uniform Distribution
6.4 Moments
6.5 M.G.F. of Discrete Uniform Distribution
6.6 Distribution of Sum of Two Discrete Uniform Random Variables
6.7 Bernoulli Distribution
6.8 Moments of Bernoulli Distribution
6.9 Distribution of Sum of independent and ldentically Distribution Bernouli Random
Variables
610 Binomial Distribution
6.11 Applications of Binomial Distribution
6.12 Moments of Binomial Distribution
6.13 M.G.F. of Binomial Distribution
6.14 Recurrence Relation
6.15 Fitting of Binomial Distribution
6.16 Mode of Binomial Distribution
o.17 RecUrrence Relation between Moments of Binomial Random Variable
6.18 Nature of the Binomial
6.19 Additive Property Distribution
(6.1)
F.Y.B.Sc. Statistics (Paper- 1) 6.2 Standard Discrete Probability
= k'-k?
= 0
Note : The use of degenerate distribution in probability theory is that it can be v
the limiting distribution of many common distributions in which the scale
parameter t
zero, so the distribution function concentrates onto a single point.
6.3 Discrete Uniform Distribution
Consider the following situation : Suppose, a class contains 50 students havine
numbers from 1 to 50. The class representative should be selected at random. Therefor
Toll number is selected randomly from 1 to 50. Thus, if X denotes the roll number seler
then since all numbers are equally likely, the p.m.f. of X is given by,
1
P(x) = 50 X = 1,2, ...., 50.
= 0 : otherwise.
Such a distribution is called as a discrete uniform distribution.
Definition : Let X be a discrete r.v. taking values 1, 2, .. n. X is said to follow 1
discrete uniform distribution if its p.m.f. is given by
1
P(X = x) = n X =1,2, ..., n.
=0 otherwise.
'n' is called as the 'parameter' of the distribution. By 'parameter (s) of a
mean the constants in the p.m.f. Whenever, the parameter value is distribution,
known, the distributoue
known completely, so that probabilities of all events as well as quantities such as
variance can be computed. For different values of the parameter, we get
different prot
distributions of the same kind. The above distribution is given the name 'uniform
because it treats all the values of the variable uniformly) Thus, the disti
distribution is applied whenever all values of the r.v. are equally likely. We discrete
give beto
such situations.
1. The birthday of a person. It may be either
Sunday,.
probability. Thus giving codes to the days as Sun Monday,
=1, Mon ...=.2. Saturday wi
..., Sat=7.
uniformn distribution withn=7.
2. Let X denote the number on the face of an
unbiased die when it is rolled.
P(x) = 6
X=1,2, ....6
0
otherwise
3. A computer gencrates a digIt randomly from 0 to 9
PX) = 10 X=0, 1,...9
= 0
otherwise.
Statistics (Paper- I) 6.5 Standard Discrete Probability Distributions (Finite)
Figure given below shows the bar diagram of a discrete uniform distribution with
parametern.
P (x)
X
1 2
Fig. 6.1
6.4 Moments
Let Xfollow a discrete uniform distribution with p.m.f.
P(X) = X= 1,2, ..., h.
= 0; otherwise
n
Hence,
(n + 1) (2n + 1) (n +1) n°
Var (X) = 6 4
symmetric.
32 = 0. The distribution is
F.Y.B.Sc. Statistics (Paper- I) 6.6
Standard Discrete
Probability
6.5 M.G.F. of Discrete Uniform Distribution
Suppose X follows a discrete uniform distribution over
Mx (t) =
(1, 2, ..., n}. Distributions
ThecMGF.fY
(
Proof: Mx () = E(e")
= e P(x)x=1
l+e+e. +eD)
and
otherwise
P, (Y = y) =
n y= l, 2, ..., n
=0
Define Z= X+ Y. Obviously Z takes otherwise
values from 2 to 2n.
Consider, P(Z=2) = P(X= 1, Y= 1) = P, (1) P, (1) =
X and Y are independent.
P(Z 3)PX1 Y= 2) +P(X = 2, Y= )=
and so on until.
= 0 otherwise
Standard Discrete Probability Distributions s
F.Y.B.Sc. Statistics (Paper-
) 6.8
(Finite)
2 pql-*=p
Mean = E(0) = 2 xP () =x=0
1
Similarly, 4, = x'P(x) =p
X=0
Define X = Y;. Note that X counts the number of "'s ie. 'successes' in n
i=1
independent Bernoulli trials.
Statistics (Paper - II) 6.9
Standard Discrete Probability Distributions (Finite)
orderto derive P[X= X], we have to calculate probability of 'x' successes in n trials.
a
istsder
apnarticular sequence of xsuccesses and remaining (n - x) failures as follows.
101100.. 1
Here I
occurs Xtimes and 0 occurs n -x times. Due to independence, probability of
sequenceIS given by -
echa
PP..p q:9...q = p'qh-x
(n- x)times
X times
Uawever, the succeSses (1's) can occupy any x places out of n places in a sequence in
ways. Therefore, using the addition principle, we get,
P[X=x] X= 0,1, ....n
= 0 otherwise
which we discuss in the next
This result leads us to the famous binomial distribution
section.
(April 2012)|
6.10 Binomial Distribution
to follow a binomial
Definition:A discrete r.v. X taking values 0, 1, 2, ... n is said
distribution with parameters n andpif its p.m.f. is given by.
P[X=x] =P)=Pq-x; X =0, 1, ... n
0<p<1
q =1-p
otherwise
= 0
of n and p are available in
Notation:X’B (n, p). The values of P(x) for various values
statistical table.
n
(0
otherwise
Statistics (Paper- I) 6.11
Standard Diserete Probability Distributions (Finite)
P[X=4) = P4) = =00823
P(X22) = 1-P(X<2)
= 1-[P (X =0) +P (XF 1)]
= 0.8683
P(XS1) = P(0) + P(1) = 0.1317 (see (i))
() Getting 4tails is equivalent to getting 2 heads.
Required probability = P(X=2)
ybabPirlotbyabil ty
we want
as 0.33333. It is a parameter P and since
POX=0)+PX)
q*npq
(0.7+10 (0,3)(0.7Y
P(Rejection of the lot)
-(07Y3.7] 9.1493
1-01493 \8507
EVB.Sc. Statistics (Paper - ) 6.13 Standard Discrete Probability Distributions (Finite)
9p² = q
9p² = (1-p'= 1-2p +p²
8p²+ 2p-1 = 0
(4p - 1) (2p + 1) = 0
1
P =7or p = -
The value p= - is inadmissible. Hence, the answer is p-i
Example 6.5 : Suppose we denote by b (x; n, p) the p.m.f. pq-x; x =0, 1, ..., n.
Then prove the following identities.
(i) b(x; n, p) =b (n -x; n, q)
(i)) b (x; n+1, p) = pb (x- 1:;n, p) + qb (x; n, p).
= qb(x; n, p) + p b (x- 1; n, p)
6.12 Moments of Binomial Distribution
Let X’ B(n, p). The p.m.f. is given by,
n
P (X) = X = 0,1, .... n
= 0 otherwise
For binomial distribution, computation of factorial moments is easier than raw or central
moments.
Standard Discrete
F.Y.B.Sc. Statistics (Paper-) 6.14 Probability
Consider. , mean xP(X) Distributions (
-pq 0
Xn!
P'qh-x
o X! (n -X) !
n!
2(x-)!(n -X)! Pq"-x
1
(n-1) !
= np 2 (x- )!(n-1-«- ) ) Plqn-x
np
0
Ee"C,p q*
= 0 'C (pe) q
= (q+ pe )"
identify the distribution
Example 6.6 : If the m.g.f. of a r.v. is Mx(t) = (0.4 + 0.6e'yo,
of X.
Solution : Since the m.g.f. matches with the form (q + pe)', by=uniqueness property of
10 and p 0.6.
n.g.f. Xfollows binomial distribution with parameters n =
Mean and variance of binomial distribution using m.g.f. :
returns the value of
We know that the first derivative of Mx(t) w.r.t. t evaluated at t=0
nean.
My (0 = tq +pe'y" pe
Evaluating this at t =0, we get,
d
Mx(0k=0
n(p + q
= np since p +q =l
Hence, in order to calculate the probabilities one must evaluate which is atedion
job especially when n and x are large. There is a chain relation between the successi
probabilities, using which the calculations become easy. This relation is called recurrenge
relation.
When X ’B (n, p), observe that
P(X+1) =)plqr-x-l; X= 0, 1, ...,n -1
and P (X) X =0, 1, ..., n
where x = 0, 1, ..,.n
Relation (i) is called as the recurrence relation. Using this, we get,
P(1) = n P(0), where P(0) =q
andDistributions
Assuming that seeds germinate independently of each other
(F
germination of aseed (p) is constant for all seeds, we say X’ B(n, p) where,
=2.35; i
n=5
= l00
probability
Step 1 : Now, X=
E xpqa-x
H = E(x) = X=0E P() =x=0 ... (1)
d
dp X=0
((xpg--p'(n-) q°-x)
(q = 1-p)
du,
P4 dp = 4
x=0
n
X=0 x=0
d
= pq dp g
(i) Since u, is the lh çentral moment of X,
T=0,1,1
4r = E (X-np) =X=0 (x- np)rpqa-x
Note that the r.h.s. involves product of three functions of p. Differentiating both
(2) w.r.t. p., we get,
du, -pqh -x
= - n -np)r
dp
+x(*-np)pq-x
- (n -x) (x- np pqn-x-I
Multiplying both sides by pq, we get.
dy = -np q rHr-tq (x- np)x P(x)
P4 dp
-pE (x-np) (n x) P()
= -npqr Hrt (x-np) P(x) (qx pn+px)
= -npqr Ht(x- np)r*l P(x)
npqr r-+ rel
el=P4 dp + npqr Mr
X=0
n
= p'g* ny - z
X=0
(n+ n,
= pqt-1, z = 0, 1,...n, +n,)
thep.m.ff. of B(n, t n2, p)
is
shich Z= X+Y’B (n, +n,, p)
Notethat in order to get the above property, 'p' must be the same
for both the
Remark:
dstibutons.
M.G.E
Alternative method :Using
The M.G.F. ofX is given by
Mx (t) = (q + pe'"
by
The M.G.F. ofYis given
My (t) = (q +pe)"
Z = X+ Y
Let
Then by additiveproperty of M.G.F.,
pe')"
Mz (0) = Mx () My () =(q + pe') (g +
= (q+pe')" *
distribution.
whichis the M.G.F. of B(n + n2, p)
. By uniqueness property of M.G.F.,
Z- B(n + n2, p)
follows binomial distribution with parameters n and P. Find
Example 6.9: Suppose X
probability distribution of Y=n-X.
X is,
Solution :X’B (n, p), hence M.G.F. of
Mx(t) = (q +pe)"
M, (0) = Ele=E(e Mxe ()
= e"Ee=e"
= e (q +pe
= [e (q +pe )]=(p + qey
= M.G.F. of B(n, q)
B (n, g).
Hence, by uniqueness property we conclude that n- Xfollows
6.20 Conditional Distribution of X given X + Y =n independent.(AprilThen2012)the
Orem : Let X - B (n,, p): Y’ B (n,, p). X and Y are
conditional I distribution of Xgiven X+Y =n is
F.Y.B.Sc. Statistics (Paper- I) 6.24 Standard Discrete
Probability Distributlions
P[X =xlX+ Y=n]=
x=0,l,
Proof : Using the additive property, we get,
X+Y ’ B(n,+ n, P)
Consider,
P[X=x, X+ Y=n]
P[X=x|X +Y =n] = P[X + Y =n]
P[X=X, Y=n-x]
P[X+ Y=n]
P[X=x] P[Y=n-x] .. X and Y
P[X+Y=n] are independent
p-g2-n+x
n-x
n+n; p"qy +ny -n
n
X=0, 1,2,.n
n
2 0.31539456 3 0.873977369 5
3 0.5930864 4 0.418837163
4 0.8263296 5 0.717595904
5 0.95019264 6 0.981714158
6 0.99148032 7 0.904301866
7 0.99934464 8 0.699300478 4
8 9 0.42897 1576 3
10 0.685586378 4