Fall 2010 Test 2 Solution

Massachusetts Institute of Technology
Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Fall 2010)
6.041/6.431 Fall 2010 Quiz 2 Solutions

Problem 1. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential random variable, independent from X , with parameter = 2. 1. (10 points) Find the mean and variance of X 3Y . E[X 3Y ] = E[X ] 3E[Y ] 1 = 23 2 1 = . 2 var(X 3Y ) = var(X ) + 9var(Y ) (4 0)2 1 = +9 2 12 2 43 = . 12 2. (10 points) Find the probability that Y X .
(Let c be the answer to this question.) The PDFs for X and Y are: fX (x) = fY (y ) = Using the total probability theorem, P(Y X ) =
x
1/4, if 0 x 4, 0, otherwise. 2e2y , if y 0, 0, otherwise.
fX (x)P(Y X | X = x) dx 4
1 (1 FY (x)) dx 0 4 4 1 2x = e dx 0 4 1 4 2x = 2e dx 8 0 1 = (1 e8 ). 8 =
Page 1 of 4

3. (10 points) Find the conditional joint PDF of X and Y , given that the event Y X has occurred. (You may express your answer in terms of the constant c from the previous part.) Let A be the event that Y X . Since X and Y are independent, fX,Y |A (x, y ) = fX,Y (x, y ) fX (x)fY (y ) = for (x, y ) A P(A) P(A) 2y 4e , if 0 x 4, y x 1e8 = 0, otherwise.
4. (10 points) Find the PDF of Z = X + Y . Since X and Y are independent, the convolution integral z 1 2t fZ (z ) = 2e dt max(0,z 4) 4 2z , 1/4 1 e 1/4 e8 1 e2z , = 0, can be used to nd fZ (z ).
if 0 z 4, if z > 4, otherwise.
5. (10 points) Provide a fully labeled sketch of the conditional PDF of Z given that Y = 3. Given that Y = 3, Z = X + 3 and the conditional PDF of Z is a shifted version of the PDF of X . The conditional PDF of Z and its sketch are: fZ |Y =3 (z ) fZ |{Y =3} (z ) = 1/4, if 3 z 7, 0, otherwise.
1 4
6. (10 points) Find E[Z | Y = y ] and E[Z | Y ]. The conditional PDF fZ |Y =y (z ) is a uniform distribution between y and y + 4. Therefore, E[Z | Y = y ] = y + 2. The above expression holds true for all possible values of y , so
E[Z | Y ] = Y + 2.
7. (10 points) Find the joint PDF fZ,Y of Z and Y . The joint PDF of Z and Y can be expressed as: fZ,Y (z, y ) = fY (y )fZ |Y (z | y ) 1/2 e2y , if y 0, y z y + 4, = 0, otherwise.
Page 2 of 4

8. (10 points) A random variable W is dened as follows. We toss a fair coin (independent of Y ). If the result is heads, we let W = Y ; if it is tails, we let W = 2 + Y . Find the probability of heads given that W = 3. Let X be a Bernoulli random variable for the result of the fair coin where X = 1 if the coin lands heads. Because the coin is fair, P(X = 1) = P(X = 0) = 1/2. Furthermore, the conditional PDFs of W given the value of X are: fW |X =1 (w) = fY (w) fW |X =0 (w) = fY (w 2). Using the appropriate variation of Bayes Rule: P(X = 1 | W = 3) = = = = P(X = 1)fW |X =1 (3) P(X = 1)fW |X =1 (3) + P(X = 0)fW |X =0 (3) P(X = 1)fY (3) P(X = 1)fY (3) + P(X = 0)fY (1) P(X = 1)fY (3) P(X = 1)fY (3) + P(X = 0)fY (1) e6 . e6 + e2
Problem 2. (30 points) Let X, X1 , X2 , . . . be independent normal random variables with mean 0 and variance 9. Let N be a positive integer random variable with E[N ] = 2 and E[N 2 ] = 5. We assume that the random variables N, X, X1 , X2 , . . . are independent. Let S = N i=1 Xi . 1. (10 points) If is a small positive number, we have P(1 |X | 1 + ) , for some constant . Find the value of . P(1 |X | 1 + ) = 2P(1 X 1 + ) 2fX (1). Therefore, = 2fX (1) 2 1 (10) 1 = 2 e 2 9 9 2 1 2 e 18 . = 3 2 2. (10 points) Find the variance of S . Using the Law of Total Variance, var(S ) = E[var(S | N )] + var(E[S | N ]) = E[9 N ] + var(0 N ) = 9E[N ] = 18. Page 3 of 4

3. (5 points) Are N and S uncorrelated? Justify your answer. The covariance of S and N is cov(S, N ) = E[SN ] E[S ]E[N ] = E[E[SN | N ]] E[E[S | N ]]E[N ]
N N = E[E[ Xi N | N ]] E[E[ Xi | N ]]E[N ] i=1 i=1
= E[X1 ]E[N 2 ] E[X1 ]E[N ] = 0 since the E[X1 ] is 0. Therefore, S and N are uncorrelated. 4. (5 points) Are N and S independent? Justify your answer. S and N are not independent. Proof : We have var(S | N ) = 9N and var(S ) = 18, or, more generally, fS |N (s | n) = N (0, 9n) and fS (s) = N (0, 18) since a sum of an independent normal random variables is also a normal random variable. Furthermore, since E[N 2 ] = 5 = (E[N ])2 = 4, N must take more than one value and is not simply a degenerate random variable equal to the number 2. In this case, N can take at least one value (with non-zero probability) that satises var(S | N ) = 9N = var(S ) = 18 and hence fS |N (s | n) = fS (s). Therefore, S and N are not independent.
Page 4 of 4
MIT OpenCourseWare http://ocw.mit.edu
6.041 / 6.431 Probabilistic Systems Analysis and Applied Probability

Fall 2010
For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

Fall 2010 Test 2 Solution

Uploaded by

Copyright:

Available Formats

Fall 2010 Test 2 Solution

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Fall 2010 Test 2 Solution

Uploaded by

Copyright:

Available Formats

Massachusetts Institute of Technology

6.041/6.431 Fall 2010 Quiz 2 Solutions

1/4, if 0 x 4, 0, otherwise. 2e2y , if y 0, 0, otherwise.

Massachusetts Institute of Technology

Massachusetts Institute of Technology

Massachusetts Institute of Technology

MIT OpenCourseWare http://ocw.mit.edu

6.041 / 6.431 Probabilistic Systems Analysis and Applied Probability

You might also like

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.