Chapter 5
Chapter 5
Chapter 5
CHAPTER-5
𝑓(𝑥)𝑑𝑥
𝑦 = 𝑓(𝑥)
𝑥 𝑥 + 𝑑𝑥
In the figure, 𝑓(𝑥)𝑑𝑥 represents the area bounded by the curve 𝑦 = 𝑓(𝑥), 𝑥-axis and ordinates at
the points 𝑥 and 𝑥 + 𝑑𝑥. The function 𝑓𝑋 (𝑥) = 𝑓(𝑥) so defined is known as probability density
function (pdf) of random variable X. The expression, 𝑓(𝑥)𝑑𝑥, usually written as 𝑑𝐹(𝑥), is known as
probability differential, and the curve 𝑦 = 𝑓(𝑥) is known as the probability density curve.
Definition: The probability density function (pdf) 𝑓𝑋 (𝑥) = 𝑓(𝑥) of the 𝑟. 𝑣. 𝑋 is defined as:
𝑃(𝑥 ≤ 𝑋 ≤ 𝑥 + 𝛿𝑥)
𝑓𝑋 (𝑥) = 𝑓(𝑥) = lim
𝛿𝑥→0 𝛿𝑥
The probability for a variate value to lie in the interval 𝑑𝑥 𝑖𝑠 𝑓(𝑥)𝑑𝑥 and hence the probability for a
variate value to fall in the finite interval [𝑎, 𝑏] is:
𝑏
𝑃(𝑎 ≤ 𝑋 ≤ 𝑏) = ∫𝑎 𝑓(𝑥)𝑑𝑥 ,
Which represents the area between the curve 𝑦 = 𝑓(𝑥), 𝑥- axis and the ordinates at 𝑥 = 𝑎 𝑎𝑛𝑑 𝑥 =
𝑏.
𝑏
▪ Further, since the total probability is unity, we have ∫𝑎 𝑓(𝑥)𝑑𝑥 = 1, where [𝑎, 𝑏] the range
of the random variable is 𝑋. The range of the variable may be finite or infinite.
The probability density function (pdf) of a random variable X, usually denoted by
𝑓𝑋 (𝑥) 𝑜𝑟 𝑠𝑖𝑚𝑝𝑙𝑦 𝑏𝑦 𝑓(𝑥) has the following obvious properties:
∞
1. 𝑓(𝑥) ≥ 0, 2. ∫−∞ 𝑓(𝑥)𝑑𝑥 = 1.
Important remarks: In the case of a discrete random variable, the probability at a point, i.e., 𝑃(𝑋 = 𝑐)
is not zero for some fixed c. However, in the case of continuous random variables, the probability at
𝑐
a point is always zero, 𝑖. 𝑒., 𝑃(𝑋 = 𝑐) = 𝑃(𝑐 ≤ 𝑋 ≤ 𝑐) = ∫𝑐 𝑓(𝑥)𝑑𝑥 = 0, ∀ 𝑐.
This property of continuous 𝑟. 𝑣. , 𝑣𝑖𝑧., 𝑃(𝑋 = 𝑐) = 0, ∀ 𝑐 leads us to the following important result:
𝑃(𝑎 ≤ 𝑋 ≤ 𝑏) = 𝑃(𝑎 ≤ 𝑋 < 𝑏) = 𝑃(𝑎 < 𝑋 ≤ 𝑏) = 𝑃(𝑎 < 𝑋 < 𝑏).
In the case of continuous 𝑟. 𝑣., it does not matter whether we include the endpoints of interval
from𝑎 𝑡𝑜 𝑏. However, this result is, in general, not true for discrete random variables.
Example: The diameter of an electric cable, say 𝑋, is assumed to be a continuous 𝑟. 𝑣. 𝑤𝑖𝑡ℎ 𝑝𝑑𝑓:
𝑓(𝑥) = 6𝑥 (1 − 𝑥) , 0 ≤ 𝑥 ≤ 1.
A). Check that 𝑓(𝑥) is 𝑝𝑑𝑓. b). Compute 𝑃(𝑋 < 1/2).
Solution:
a. Obviously, for 0 ≤ 𝑥 ≤ 1, 𝑓(𝑥) ≥ 0. Now
1
1 1 1 2 𝑥2 𝑥3
∫0 𝑓(𝑥)𝑑𝑥 = 6 ∫0 𝑥 (1 − 𝑥)𝑑𝑥 = 6 ∫0 (𝑥 − 𝑥 )𝑑𝑥 = 6 | 2 − 3 | . = 1. Hence 𝑓(𝑥) is 𝑝𝑑𝑓.
0
1
1 1
1 1 𝑥2 𝑥3 2
b. 𝑃 (𝑋 < 2) = 𝑃 (0 < 𝑋 < 2) = ∫0 𝑓(𝑥)𝑑𝑥 = ∫0 6𝑥 (1 − 𝑥)𝑑𝑥 = 6 | 2 −
2 2 | = 0.5.
3 .
0
Exercise: Let 𝑋 be a continuous random variable with 𝑝𝑑𝑓:
𝑎𝑥 , 0≤𝑥<1
𝑎 , 1≤𝑥<2
𝑓(𝑥) = {−𝑎𝑥 + 3𝑎 , 2≤𝑥<3
0 , 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
a). Determine the constant 𝑎. b). Compute 𝑃(𝑋 ≤ 1.5).
Ans: a). 𝑎 = 1/2. b). 𝑃(𝑋 ≤ 1.5) = 1/2.
By Hussein M. Lecture Notes Page 3
SU Stat Dept Probability and Statistics (Stat2171) Chapter -5
Definition: Let 𝑋 be a random variable. The function 𝐹 defined for all 𝑟𝑒𝑎𝑙 𝑥 by
𝐹(𝑥) = 𝑃(𝑋 ≤ 𝑥) , − ∞ < 𝑥 < ∞,
Is called the cumulative distribution function (CDF) of the random variable𝑋.
∑𝑖:𝑥𝑖 ≤𝑥 𝑝𝑖 → 𝐼𝑓 𝑋 𝑖𝑠 𝑑𝑖𝑠𝑐𝑟𝑒𝑡𝑒.
Thus, 𝐹(𝑥) = 𝑃(𝑋 ≤ 𝑥) = { 𝑥
∫−∞ 𝑓(𝑡)𝑑𝑡 → 𝐼𝑓 𝑋 𝑖𝑠 𝑐𝑜𝑛𝑡𝑖𝑛𝑢𝑜𝑢𝑠.
Properties of a cumulative distribution function
1. If 𝐹 is the 𝑐𝑑𝑓 of one-dimensional r.v. X, then (𝑖). 0 ≤ 𝐹(𝑥) ≤ 1 ; (𝑖𝑖). 𝐹(𝑥) ≤ 𝐹(𝑦) 𝑖𝑓 𝑥 <
𝑦.
• In other words, all distribution functions are monotonically non-decreasing and lie
between 0 and 1.
2. If 𝐹 is the 𝑐𝑑𝑓 of one-dimensional 𝑟. 𝑣. 𝑋, then
𝐹(−∞) = lim 𝐹(𝑥) = 0 𝑎𝑛𝑑 𝐹(∞) = lim 𝐹(𝑥) = 1.
𝑥→−∞ 𝑥→∞
3. 𝐼𝑓 𝐹 𝑖𝑠 𝑡ℎ𝑒 𝑐𝑑𝑓 𝑜𝑓 𝑡ℎ𝑒 𝑟. 𝑣. 𝑋 𝑎𝑛𝑑 𝑖𝑓 𝑎 ≤ 𝑏, then 𝑃(𝑎 ≤ 𝑋 ≤ 𝑏) = 𝐹(𝑏) − 𝐹(𝑎).
Remark: When 𝑃(𝑋 = 𝑎) = 0 𝑎𝑛𝑑 𝑃(𝑋 = 𝑏) = 0, 𝑎𝑙𝑙 𝑓𝑜𝑢𝑟 𝑒𝑣𝑒𝑛𝑡𝑠 𝑎 ≤ 𝑋 ≤ 𝑏, 𝑎 ≤ 𝑋 <
𝑏, 𝑎 < 𝑋 ≤ 𝑏 𝑎𝑛𝑑 𝑎 < 𝑋 < 𝑏 have the same probability 𝐹(𝑏) − 𝐹(𝑎).
𝑑𝐹(𝑥)
Note that: 𝐹 ′ (𝑥) = 𝑑𝑥 = 𝑓(𝑥). 𝑎𝑛𝑑 𝑝(𝑥𝑖 ) = 𝑃(𝑋 = 𝑥𝑖 ) = 𝐹(𝑥𝑖 ) − 𝐹(𝑥𝑖−1 ).
Graphs of the discrete and continuous distribution function for the random variable X.
F(x) F(x)
x x
1 2 3 4 5 6 7
1 1 9 9
= + (1 − ) + (− + + 1 − 3) = 1.
4 2 4 2
Hence the cumulative distribution function 𝐹(x) is given by:
0 𝑓𝑜𝑟 − ∞ ≤ 𝑥 < 0
x2
𝑓𝑜𝑟 0 ≤ 𝑥 < 1
4
2x − 1
𝐹(𝑥) = 𝑓𝑜𝑟 1 ≤ 𝑥 < 2
4
𝑥 2 3𝑥 5
− 4 + 2 −4 𝑓𝑜𝑟 2 ≤ 𝑥 < 3
{ 1 𝑓𝑜𝑟 3 ≤ 𝑥 < ∞