Yates and Goodman: Probability and Stochastic Processes Solutions Manual
150
Problem Solutions Chapter 5
Problem 5.1.1
(a) The probability P[X 2; Y 3] can be found be evaluating the joint CDF FX ;Y (x; y)
at x = 2 and y = 3. This yields
P[X
2 Y 3] = FX Y (2 3) = (1 , e,2 )(1 , e,3)
;
(b) To find the marginal CDF of X, FX (x), we simply evaluate the joint CDF at y = .
FX (x) = FX ;Y (x; ) =
1 , e,x x 0
0
otherwise
(c) Likewise for the marginal CDF of Y , we evaluate the joint CDF at X
FY (y) = FX ;Y (; y) =
= .
1 , e,y y 0
0
otherwise
Problem 5.1.2
(a) Because the probability that any random variable is less than , is zero, we have
FX ;Y (x; ,) = P[X
x Y ,] P[Y ,] = 0
;
(b) The probability that any random variable is less than infinity is always one.
FX ;Y (x; ) = P[X
(c) Although P[Y
x Y ] = P[X x] = FX (x)
;
] = 1, P[X ,] = 0. Therefore the following is true.
FX Y (, ) = P[X , Y ] P[X ,] = 0
;
(d) Part (d) follows the same logic as that of part (a).
FX ;Y (,; y) = P[X
, Y y] P[X ,] = 0
;
(e) Analogous to Part (b), we find that
FX ;Y (; y) = P[X
Y y] = P[Y y] = FY (y)
;
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
Problem 5.1.3
We wish to find P[x1 X x2 ] or P[y1 Y
and B = fy1 Y y2 g. Then
y2 ].
151
Define events A = fy1 Y
y2 g
P[A [ B] = P[A] + P[B] , P[AB]
Where the intersection of events A and B are all the outcomes such that both A and B occur,
specifically,
AB = fx1 X x2 ; y1 Y y2 g.
P[A [ B] = P[x1 X
x2 ] + P[y1 Y y2 ] , P[x1 X x2 y1 Y y2 ]
;
By Theorem 5.3,
P[x1 X
x2 y1 Y y2] = FX Y (x2 y2) , FX Y (x2 y1 ) , FX Y (x1 y2 ) + FX Y (x1 y1)
;
Expressed in terms of the marginal and joint CDFs,
P[A [ B] = FX (x2 ) , FX (x1 ) + FY (y2 ) , FY (y1 )
, FX ;Y (x2 ; y2 ) + FX ;Y (x2; y1 ) + FX ;Y (x1 ; y2) , FX ;Y (x1 ; y1 )
Problem 5.1.4
Its easy to show that the properties of Theorem 5.1 are satisfied. However, those properties are necessary but not sufficient to show F (x; y) is a CDF. To convince ourselves that
F (x; y) is a valid CDF, we show that for all x1 x2 and y1 y2 ,
P[x1 < X1 x2 ; y1 < Y
y2] 0
In this case, for x1 x2 and y1 y2 , Theorem 5.3 yields
P[x1 < X
x2 y1
;
<
y2] = F (x2 y2 ) , F (x1 y2 ) , F (x2 y1) + F (x1 y1)
= FX (x2 ) FY (y2 ) , FX (x1 ) FY (y2 )
, FX (x2 ) FY (y1 ) + FX (x1 ) FY (y1 )
= [FX (x2 ) , FX (x1 )][FY (y2 ) , FY (y1 )]
0
;
Hence, FX (x) FY (y) is a valid joint CDF.
Problem 5.1.5
In this problem, we prove Theorem 5.3 which states
P[x1 < X
x2 y1
;
<
y2] = FX Y (x2 y2) , FX Y (x2 y1 ) , FX Y (x1 y2 ) + FX Y (x1 y1)
;
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
152
(a) The events A, B, and C are
Y
y2
y2
y2
y1
y1
y1
x1
x1
x2
x2
x1
(b) In terms of the joint CDF FX ;Y (x; y), we can write
P[A] = FX ;Y (x1 ; y2 ) , FX ;Y (x1 ; y1 )
P[B] = FX ;Y (x2 ; y1 ) , FX ;Y (x1 ; y1 )
P[A [ B [ C] = FX ;Y (x2 ; y2 ) , FX ;Y (x1 ; y1 )
(c) Since A, B, and C are mutually exclusive,
P[A [ B [ C] = P[A] + P[B] + P[C]
However, since we want to express P[C] = P[x1 < X
the joint CDF FX ;Y (x; y), we write
x2 y1
;
<
y2 ] in terms of
P[C] = P[A [ B [ C] , P[A] , P[B]
= FX ;Y (x2 ; y2 ) , FX ;Y (x1 ; y2 ) , FX ;Y (x2 ; y1 ) + FX ;Y (x1 ; y1 )
which completes the proof of the theorem.
Problem 5.1.6
The given function is
FX ;Y (x; y) =
1 , e,(x+y) x; y 0
0
otherwise
First, we find the CDF FX (x) and FY (y).
FX (x) = FX ;Y (x; ) =
FY (y) = FX ;Y (; y) =
1 x0
0 otherwise
1 y0
0 otherwise
Hence, for any x 0 or y 0,
P[X
>
x] = 0
P[Y
>
y] = 0
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
For x 0 and y 0, this implies
P[fX
>
xg[fY
>
yg] P[X
>
x] + P[Y
>
153
y] = 0
However,
x Y y] = 1 , (1 , e, x y ) = e, x y
Thus, we have the contradiction that e, x y 0 for all x y 0. We can conclude that the
P[fX
>
xg[fY
>
yg] = 1 , P[X
( + )
( + )
( + )
given function is not a valid CDF.
Problem 5.2.1
(a) The joint PDF of X and Y is
fX ;Y (x; y) =
Y
Y+X=1
c x + y 1; x; y 0
0 otherwise
X
1
To find the constant c we integrate over the region shown. This gives
Z 1 Z 1,x
0
c dy dx = cx ,
cx 1 c
=
2 0 2
=1
Therefore c = 2.
(b) To find the P[X
Y ] we look to integrate over the area indicated by the graph
P[X
Y] =
Z 1=2 Z 1,x
0
(2
dy dx
X Y
X=Y
Z 1=2
=
, 4x) dx
= 1=2
(c) The probability P[X + Y
the following integrals
P[X + Y
1
1
2]
2] can be seen in the figure at right. Here we can set up
Z 1=2 Z 1=2,x
0
Z 1=2
=
=
2 dy dx
(1
Y+X=1
Y+X=
, 2x) dx
1=2 , 1=4 = 1=4
X
1
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
154
Problem 5.2.2
Given the joint PDF
fX ;Y (x; y) =
cxy2 0 x; y 1
0
otherwise
(a) To find the constant c integrate fX ;Y (x; y) over the all possible values of X and Y to
get
Z 1Z 1
1=
0
cxy2 dx dy = c=6
Therefore c = 6.
(b) The probability P[X
shaded region.
Y ] is the integral of the joint PDF fX Y (x y) over the indicated
;
P[X
Y] =
Z 1Z x
6xy dy dx
0
Z 1
2x4 dx
= 2=5
Similarly, to find P Y X 2 we can integrate over the
region shown in the figure.
PY
X2
Z 1 Z x2
=
0
1
Y=X 2
6xy2 dy dx = 1=4
(c) Here we can choose to either integrate fX ;Y (x; y) over the lighter shaded region,
which would require the evaluation of two integrals, or we can perform one integral over the darker region by recognizing
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
P[min(X ; Y ) 1=2] = 1 , P[min(X ; Y ) > 1=2]
=1
=1
Z 1 Z 1
1=2 1=2
Z 1
9y2
1=2
155
min(X,Y) <
min(X,Y) >
6xy2 dx dy
dy =
11
32
1
(d) The P[max(X ; Y ) 3=4] can be found be integrating over the shaded region shown
below.
P[max(X ; Y ) 3=4] = P[X
Z
3
4
3
3
4
4Y
= ;
3
4]
max(X,Y) <
6xy2 dx dy
0 0
3=4
2 3=4
= x
y3
0
5
= (3=4) = 0:237
Problem 5.2.3
fX ;Y (x; y) =
(a) The probability that X
P[X
Y] =
=
=
Y is:
Z Z x
Z0
Z0
0
The P[X + Y
6e,(2x+3y) x 0; y 0
0
otherwise
6e,(2x+3y) dy dx
2e,2x
Y
X Y
,e,3y yy==x0 dx
,2x , 2e,5x ] dx = 3=5
[2e
1] is found by integrating over the region where X + Y 1
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
P[X + Y
1] =
Z 1 Z 1,x
0
Z 1
2e,2x
Z 1
=
0
6e,(2x+3y) dy dx
h
,e,3y yy==10,x dx
156
Y
X+Y 1
2e,2x 1 , e,3(1,x) dx
,2x , 2ex,3 1
= ,e
0
,
3
,
2
= 1 + 2e , 3e
(b) The event min(X ; Y ) 1 is the same as the event fX
P[min(X ; Y ) 10] =
Z Z
1
Z 1Z 1
0
6e,(2x+3y) dy dx = e,(2+3)
(c) The event max(X ; Y ) 1 is the same as the event fX
P[max(X ; Y ) 1] =
1 Y 1g. Thus,
1 Y 1g so that
;
6e,(2x+3y) dy dx = (1 , e,2 )(1 , e,3 )
Problem 5.2.4
The only difference between this problem and Example 5.2 is that in this problem we
must integrate the joint PDF over the regions to find the probabilities. Just as in Example 5.2, there are five cases. We will use variable u and v as dummy variables for x and
y.
x < 0 or y < 0
Y
1
In this case, the region of integration doesnt overlap the region of nonzero probability and
Z y Z x
FX ;Y (x; y) =
, ,
fX ;Y (u; v) du dv = 0
X
x
0<yx1
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
In this case, the region where the integral has a
nonzero contribution is
Z,yZ ,
x
fX ;Y (u; v) dy dx
y
8uv du dv
Z0 y v
=
=
Y
1
Z y Z x
FX ;Y (x; y) =
157
4(x2 , v2 )v dv
X
x
v=y
2x2 v2 , v4 v=0 = 2x2 y2 , y4
0 < x y and 0 x 1
Y
Z y Z x
FX ;Y (x; y) =
Z,xZ ,
u
fX ;Y (u; v) dv du
8uv dv du
Z0 x 0
4u3 du
0
4
1 x
=x
0 < y 1 and x 1
Y
Z y Z x
FX ;Y (x; y) =
, ,
fX ;Y (u; v) dv du
Z yZ 1
=
2
= 2y
x 1 and y 1
8uv du dv
0
Z y
=
4v(1 , v2 ) dv
, y4
X
x
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
158
Y
y
1
In this case, the region of integration completely
covers the region of nonzero probability and
Z y Z x
FX ;Y (x; y) =
fX ;Y (u; v) du dv = 1
, ,
X
1 x
The complete answer for the joint CDF is
8
0
>
>
>
>
< 2x2 y2
FX ;Y (x; y) =
x4
>
>
2y2
>
>
:
, y4
, y4
x < 0 or y < 0
0<yx1
0 x y; 0 x 1
0 y 1; x 1
x 1; y 1
Problem 5.3.1
(a) The joint PDF (and the corresponding region of nonzero probability) are
Y
fX ;Y (x; y) =
1=2 ,1 x y 1
0
otherwise
-1
(b)
P[X
>
0] =
Z 1Z 1
1
0
dy dx =
Z 1
1
, x dx = 1
2
This result can be deduced by geometry. The shaded triangle of the X ; Y plane corresponding to the event X > 0 is 1=4 of the total shaded area.
(c) For x > 1 or x < ,1, fX (x) = 0. For ,1 x 1,
fX (x) =
fX ;Y (x; y) dy =
Z 1
1
x
dy = (1 , x)=2
The complete expression for the marginal PDF is
fX (x) =
(1
, x)
,1 x 1
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
159
(d) From the marginal PDF fX (x), the expected value of X is
E [X ] =
x fX (x) dx =
1 1
x2 x3
1
x(1 , x) dx =
,
=,
2 ,1
4
6 ,1
3
Problem 5.3.2
fX ;Y (x; y) =
2 x + y 1; x; y 0
0 otherwise
Using the figure to the left we can find the marginal PDFs by integrating over the appropriate regions.
fX (x) =
Z 1,x
2(1 , x) 0 x 1
0
otherwise
2(1 , y) 0 y 1
0
otherwise
2 dy =
Y
Y+X=1
Likewise for fY (y):
fY (y) =
Z 1,y
0
2 dx =
X
1
Problem 5.3.3
Random variables X and Y have joint PDF
fX ;Y (x; y) =
1=(r2 ) 0 x2 + y2 r2
0
otherwise
The marginal PDF of X is
Z
p2
,x2 1
fX (x) = 2 p
dy =
, r2 ,x2 r2
And similarly for fY (y)
pr ,y
p
, r ,y
fY (y) = 2
2
2
1
dx =
r2
2 r2 ,x2
r2
p r ,y
r2
,r x r
otherwise
,r y r
otherwise
Problem 5.3.4
The joint PDF of X and Y and the region of nonzero probability are
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
160
5x2 =2 ,1 x 1; 0 y x2
0
otherwise
fX ;Y (x; y) =
-1
We can find the appropriate marginal PDFs by integrating the joint PDF.
(a) The marginal PDF of X is
fX (x) =
Z x2 2
5x
dy =
5x4 =2 ,1 x 1
0
otherwise
(b) Note that fY (y) = 0 for y > 1 or y < 0. For 0 y 1,
Y
fY (y) =
= 5(1
,py 5x2
fX ;Y (x; y) dx =
,y
3=2
,1
Z 1
5x2
dx + p
dx
y 2
)=3
-1 - y
X
1
The complete expression for the marginal CDF of Y is
fY (y) =
5(1 , y3=2 )=3 0 y 1
0
otherwise
Problem 5.3.5
In this problem, the joint PDF is
fX ;Y (x; y) =
2 jxyj =r4 0 x2 + y2 r2
0
otherwise
(a) Since jxyj = jxjjyj, for ,r x r, we can write
p2
r ,x
2 jxj
fX (x) =
fX ;Y (x; y) dy = 4
jyj dy
p
r
,
, r2 ,x2
Since jyj is symmetric about the origin, we can simplify the integral to
fX (x) =
4 jxj
r4
p2
,x2
y dy =
2 2
2 jxj 2 r ,x
y
r4 0
2 jxj (r2 , x2 )
r4
Note that for jxj > r, fX (x) = 0. Hence the complete expression for the PDF of X is
(
fX (x) =
2jxj(r2 ,x2 )
r4
,r x r
otherwise
(b) Note that the joint PDF is symmetric in x and y so that fY (y) = fX (y).
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
161
Problem 5.3.6
(a) The joint PDF of X and Y and the region of nonzero probability are
Y
cy 0 y x 1
0 otherwise
fX ;Y (x; y) =
(b) To find the value of the constant, c, we integrate the joint PDF over all x and y.
Z 1Z x
Z Z
, ,
fX ;Y (x; y) dx dy =
cy dy dx =
0
Z 1 2
cx
0
dx =
cx3
c
=
6 0 6
Thus c = 6.
(c) We can find the CDF FX (x) = P[X x] by integrating the joint PDF over the event
X x. For x < 0, FX (x) = 0. For x > 1, FX (x) = 1. For 0 x 1,
ZZ
FX (x) =
x0 x
Z x Z x0
fX ;Y
x0 ; y0 dy0 dx0
6y0 dy0 dx0
Z0 x 0
3(x0 )2 dx0 = x3
The complete expression for the joint CDF is
8
< 0
FX (x) =
x3
x<0
0x1
x1
(d) Similarly, we find the CDF of Y by integrating fX ;Y (x; y) over the event Y
y < 0, FY (y) = 0 and for y > 1, FY (y) = 1. For 0 y 1,
ZZ
FY (y) =
=
y0 y
Z yZ 1
0
Z y
=
y0
fX ;Y
y. For
x0 ; y0 dy0 dx0
6y0 dx0 dy0
6y0 (1 , y0 ) dy0 = 3(y0 )2 , 2(y0 )3 0 = 3y2 , 2y3
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
162
The complete expression for the CDF of Y is
8
< 0
FY (y) =
(e) To find P[Y
X
y<0
3y2 , 2y3 0 y 1
:
1
y>1
2], we integrate the joint PDF fX ;Y (x; y) over the region y x=2.
P[Y
X
Z 1 Z x=2
2] =
Z 1
=
0
6y dy dx
x=2
Z 1 2
3x
0
3y2 0 dx
dx = 1=4
Problem 5.4.1
(a) The minimum value of W is W = 0, which occurs when X = 0 and Y = 0. The
maximum value of W is W = 1, which occurs when X = 1 or Y = 1. The range of W
is SW = fwj0 w 1g.
(b) For 0 w 1, the CDF of W is
FW (w) = P[max(X ; Y ) w]
= P[X w; Y w]
W<w
Z wZ w
fX ;Y (x; y) dy dx
Substituting fX ;Y (x; y) = x + y yields
Z wZ w
FW (w) =
Z w
(x + y) dy dx =
y=w !
y2
xy +
2 y=0
Z w
dx =
The complete expression for the CDF is
8
< 0
FW (w) =
w3
1
w<0
0w1
otherwise
(c) The PDF of W is found by differentiating the CDF.
fY (y) =
dFW (w)
dw
3w2 0 w 1
0
otherwise
2
3
(wx + w =2) dx = w
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
163
Problem 5.4.2
(a) Since the joint PDF fX ;Y (x; y) is nonzero only for 0 y x 1, we observe that
W = Y , X 0 since Y X . In addition, the most negative value of W occurs when
Y = 0 and X = 1 and W = ,1. Hence the range of W is SW = fwj, 1 w 0g.
(b) For w < ,1, FW (w) = 0. For w > 0, FW (w) = 1. For ,1 w 0, the CDF of W is
FW (w) = P[Y , X
w]
Z 1 Z x+w
,w
Z 1
=
,w
Y=X+w
6y dy dx
0
3(x + w)2 dx = (x + w)3 ,w = (1 + w)3
-w
Therefore, the complete CDF of W is
8
< 0
FW (w) =
(1 + w)3
w < ,1
,1 w 0
w>0
(c) By taking the derivative of fW (w) with respect to w, we obtain the PDF
fW (w) =
3(w + 1)2 ,1 w 0
0
otherwise
Problem 5.4.3
Random variables X and Y have joint PDF
Y
fX ;Y (x; y) =
2 0yx1
0 otherwise
1
(a) Since X and Y are both nonnegative, W = Y =X 0. Since Y X , W = Y =X 1.
Note that W = 0 can occur if Y = 0. Thus the range of W is SW = fwj0 w 1g.
(b) For 0 w 1, the CDF of W is
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
FW (w) = P[Y =X
w] = P[Y wX ] = w
The complete expression for the CDF is
164
8
< 0
P[Y<wX]
w<0
w 0w<1
FW (w) =
:
1 w1
(c) By taking the derivative of the CDF, we find that the PDF of W is
fW (w) =
1 0w<1
0 otherwise
(d) We see that W has a uniform PDF over [0; 1]. Thus E [W ] = 1=2.
Problem 5.4.4
Random variables X and Y have joint PDF
Y
fX ;Y (x; y) =
2 0yx1
0 otherwise
1
(a) Since fX ;Y (x; y) = 0 for y > x, we can conclude that Y X and that W = X =Y 1.
Since Y can be arbitrarily small but positive, W can be arbitrarily large. Hence the
range of W is SW = fwjw 1g.
(b) For w 1, the CDF of W is
FW (w) = P[X =Y w]
= 1 , P[X =Y > w]
= 1 , P[Y < X =w]
= 1 , 1=w
P[Y<X/w]
1/w
1
Note that we have used the fact that P[Y < X =w] equals 1=2 times the area of the
corresponding triangle. The complete expression for the joint PDF is
FW (w) =
0
w<1
1 , 1=w w 1
(c) The PDF of W is found by differentiating the CDF.
fW (w) =
dFW (w)
dw
1=w2 w 1
0
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
165
Problem 5.4.5
The position of the mobile phone is equally likely to be anywhere in the area of a circle
with radius 16 km. Let X and Y denote the position of the mobile. Since we are given that
the cell has a radius of 4 km, we will measure X and Y in kilometers. Assuming the base
station is at the origin of the X ; Y plane, the joint PDF of X and Y is
1
x2 + y2 16
otherwise
16
fX ;Y (x; y) =
Since the radial distance of the mobile from the base station is R =
R is
FR (r)
P[R r] = P X 2 + Y 2 r
X 2 + Y 2 , the CDF of
By changing to polar coordinates, we see that for 0 r 4 km,
FR (r) =
Z 2 Z r 0
r
0
So
dr0 d0 = r2 =16
16
8
< 0
FR (r) =
r<0
0r<4
r4
r2 =16
Then by taking the derivative with respect to r we arrive at the PDF
fR (r) =
Problem 5.5.1
The joint PDF of X and Y is
fX ;Y (x; y) =
r=8 0 r 4
0
otherwise
(x + y)=3
0 x 1; 0 y 2
otherwise
Before calculating moments, we first find the marginal PDFs of X and Y . For 0 x 1,
fX (x) =
For 0 y 2,
fX ;Y (x; y) dy =
fY (y) =
fX ;Y (x; y) dx =
Z 2
x+y
y=2
dy =
x=1
Z 1
x
0
y
x2 xy
2y + 1
+
dx =
+
=
3 3
6
3 x=0
6
Complete expressions for the marginal PDFs are
2x+2
fX (x) =
xy y2
2x + 2
+
=
3
6 y=0
3
0x1
otherwise
fY (y) =
2y+1
6
0y2
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
166
(a) The expected value of X is
Z
E [X ] =
x fX (x) dx =
Z 1
2x + 2
dx =
2x3 x2
5
+
=
9
3 0 9
The second moment of X is
1
Z 1
2 Z 2
x4 2x3
7
2 2x + 2
dx =
x fX (x) dx =
x
+
E X =
=
The variance of X is Var [X ] = E X 2
, (E [X ])2 = 7
18
18 , (5=9)2 = 13=162.
(b) The expected value of Y is
Z
E [Y ] =
y fY (y) dy =
Z 2
2y + 1
dy =
y2 y3
11
+
=
12 9 0
9
The second moment of Y is
2
Z 2
2 Z 2
y3 y4
16
2 2y + 1
E Y =
dy =
y fY (y) dy =
y
+
=
6
18 12
9
0
,
The variance of Y is Var [Y ] = E Y 2
, (E [Y ])2 = 23
81.
(c) The correlation of X and Y is
ZZ
E [XY ] =
xy fX ;Y (x; y) dx dy
Z 1Z 2
=
0
Z 1
=
x+y
xy
3
dy dx
y=2 !
x2 y2 xy3
+
6
9 y=0
dx
8x
+
3
9
2x3 4x2
2
+
=
9
9 0 3
Z 1 2
2x
0
dx =
The covariance is Cov [X ; Y ] = E [XY ] , E [X ]E [Y ] = ,1=81.
(d) The expected value of X and Y is
E [X + Y ] = E [X ] + E [Y ] = 5=9 + 11=9 = 16=9
(e) By Theorem 5.10,
Var [X + Y ] = Var [X ] + Var [Y ] + 2 Cov [X ; Y ] =
13
23 2
+
,
162 81 81
55
162
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
Problem 5.5.2
(a) The first moment of X is
Z 1Z 1
E [X ] =
Z 1
4x y dy dx =
0
2x2 dx =
2
3
The second moment of X is
Z 1
2 Z 1 Z 1 3
1
E X =
4x y dy dx =
2x3 dx =
0
The variance of X is Var [X ] = E X 2
, (E [X ])2 = 1 2 , (2
=
3)2 = 1=18.
(b) The mean of Y is
Z 1Z 1
E [Y ] =
4xy dy dx =
Z 1
4x
dx =
2
3
x dx =
1
2
The second moment of Y is
E Y2
Z 1Z 1
=
The variance of Y is Var [Y ] = E Y 2
4xy3 dy dx =
Z 1
0
, (E [Y ])2 = 1 2 , (2
=
3)2 = 1=18.
(c) To find the covariance, we first find the correlation
Z 1Z 1
E [XY ]
2 2
4x y dy dx =
0
Z 1 2
4x
dx =
4
9
The covariance is thus
Cov [X ; Y ] = E [XY ] , E [X ]E [Y ] =
2
4
2
,
9
3
=0
(d)
E [X + Y ] = E [X ] + E [Y ] =
2 2
+
3 3
(e) By Theorem 5.10, the variance of X + Y is
Var [X + Y ]
Var [X ] + Var [Y ] + 2 Cov [X ; Y ] = 1=18 + 1=18 + 0 = 1=9
167
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
168
Problem 5.5.3
The joint PDF of X and Y and the region of nonzero probability are
Y
fX ;Y (x; y) =
5x2 =2 ,1 x 1; 0 y x2
0
otherwise
-1
(a) The first moment of X is
E [X ]
Z 1 Z x2
5x2
,1
dy dx =
Z 1
5x5
,1 2
dx =
5x6
=0
12 ,1
Since E [X ] = 0, the variance of X and the second moment are both
1
2 Z 1 Z x2 2 5x2
5x7
10
Var [X ] = E X =
dy dx =
x
=
2
14 ,1 14
,1 0
(b) The first and second moments of Y are
Z 1 Z x2
5x2
5
2
14
,1 0
Z
Z
2
1
5x
5
E Y2 =
dy dx =
x2 y2
2
26
,1 0
E [Y ] =
dy dx =
Therefore, Y has variance
Var [Y ] =
5
5
,
26
14
2
= :0576
(c) Since E [X ] = 0, Cov [X ; Y ] = E [XY ] , E [X ]E [Y ] = E [XY ]. Thus,
Z 1 Z x2
Cov [X ; Y ] = E [XY ] =
1 5x7
5x2
dy dx =
dx = 0
xy
2
,1 4
(d) The expected value of the sum X + Y is
E [X + Y ] = E [X ] + E [Y ] =
5
14
(e) By Theorem 5.10, the variance of X + Y is
Var [X + Y ] = Var [X ] + Var [Y ] + 2 Cov [X ; Y ] = 5=7 + 0:0576 = 0:7719
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
169
Problem 5.5.4
Random variables X and Y have joint PDF
Y
fX ;Y (x; y) =
2 0yx1
0 otherwise
Before finding moments, it is helpful to first find the marginal PDFs. For 0 x 1,
fX (x) =
Z x
fX ;Y (x; y) dy =
2 dy = 2x
0
Note that fX (x) = 0 for x < 0 or x > 1. For 0 y 1,
Z
fY (y) =
Z 1
fX ;Y (x; y) dx =
2 dx = 2(1 , y)
Also, for y < 0 or y > 1, fY (y) = 0. Complete expressions for the marginal PDFs are
fX (x) =
2x 0 x 1
0 otherwise
2(1 , y) 0 y 1
0
otherwise
fY (y) =
(a) The first two moments of X are
Z
E [X ] =
Z 1
x fX (x) dx =
2x2 dx = 2=3
Z 1
2 Z 2
E X =
x fX (x) dx =
2x3 dx = 1=2
The variance of X is Var [X ] = E X 2
, (E [X ])2 = 1 2 , 4
=
9 = 1=18.
(b) The expected value and second moment of Y are
Z
E [Y ] =
Z 1
y fY (y) dy =
2y(1 , y) dy =
Z 1
2 Z 2
E Y =
y fY (y) dy =
2y2 (1
The variance of Y is Var [Y ] = E Y 2
2y3
y ,
= 1=3
3 0
2
, y) dy =
, (E [Y ])2 = 1 6 , 1
=
2y3 y4
, 2 = 1=6
3
0
9 = 1=18.
(c) Before finding the covariance, we find the correlation
Z 1Z x
E [XY ] =
Z 1
2xy dy dx =
0
x3 dx = 1=4
The covariance is Cov [X ; Y ] = E [XY ] , E [X ]E [Y ] = 1=36.
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
170
(d) E [X + Y ] = E [X ] + E [Y ] = 2=3 + 1=3 = 1
(e) By Theorem 5.10, Var [X + Y ] = Var [X ] + Var [Y ] + 2 Cov [X ; Y ] = 1=6.
Problem 5.5.5
Random variables X and Y have joint PDF
fX ;Y (x; y) =
1=2 ,1 x y 1
0
otherwise
1
The region of possible pairs (x; y) is shown to the right of the joint
PDF.
-1
(a)
E [XY ] =
Z 1Z 1
xy
,1
dy dx =
1 1
x2 x4
x(1 , x2 ) dx =
,
=0
4 ,1
8 16 ,1
(b)
X +Y Z 1 Z 1 1 x y
E e
=
e e dy dx
=
=
,1 x 2
Z
1 1 x 1
e (e , ex ) dx
2 ,1
1 1+x 1 2x 1
e , e
2
4
,1
=
e2 e,2 1
+
,2
4
4
Problem 5.6.1
(a) Given the event A = fX + Y
P[A] =
1g, we wish to find fX Y jA (x y). First we find
;
Z 1 Z 1,x
0
6e,(2x+3y) dy dx = 1 , 3e,2 + 2e,3
So then
(
fX ;Y jA (x; y) =
6e,(2x+3y)
1,3e,2 +2e,3
x + y 10; x 0; y 0
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
171
Problem 5.6.2
The joint PDF of X and Y is
fX ;Y (x; y) =
1 is
(a) The probability that Y
P[A] = P[Y
0 x 1; 0 y 2
otherwise
(x + y)=3
1] =
ZZ
y1
Z 1Z 1
=
0
Z 1
=
fX ;Y (x; y) dx dy
x+y
dy dx
3
!
y=1
xy y2
+
3
6 y=0
Z 1
2x + 1
0
dx =
Y 1
dx
1
x2 x
1
+ =
6 6 0 3
(b) By Definition 5.5, the conditional joint PDF of X and Y given A is
(
fX ;Y jA (x; y) =
2A
fX ;Y (x;y)
P[A]
(x; y)
otherwise
x + y 0 x 1; 0 y 1
0
otherwise
(c) From fX ;Y jA (x; y), we find the conditional marginal PDF fX jA (x). For 0 x 1,
fX jA (x) =
fX ;Y jA (x; y) dy =
y=1
Z 1
0
(x + y) dy =
y2
1
xy +
= x+
2 y=0
2
The complete expression is
x + 1=2 0 x 1
0
otherwise
fX jA (x) =
(d) For 0 y 1, the conditional marginal PDF of Y is
fY jA (y) =
x=1
fX ;Y jA (x; y) dx =
Z 1
0
(x + y) dx =
x2
+ xy
= y + 1=2
2
x=0
The complete expression is
fY jA (y) =
y + 1=2 0 y 1
0
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
172
Problem 5.6.3
Random variables X and Y have joint PDF
fX ;Y (x; y) =
(4x + 2y)=3
0 x 1; 0 y 1
otherwise
1 2 is
ZZ
P[A] = P[Y 1 2] =
(a) The probability that Y
y1=2
Z 1 Z 1=2
fX ;Y (x; y) dy dx
4x + 2y
dy dx
3
y=1=2
Z 1
4xy + y2
=
dx
3
0
=
Z 1
2x + 1=4
y=0
dx =
x2
x
5
+
=
3 12 0 12
(b) The conditional joint PDF of X and Y given A is
(
fX ;Y jA (x; y) =
2A
fX ;Y (x;y)
P[A]
(x; y)
otherwise
=
8(2x + y)=5 0 x 1; 0 y 1=2
0
otherwise
(c) For 0 x 1, the PDF of X given A is
fX jA (x) =
fX ;Y jA (x; y) dy =
8
5
The complete expression is
Z 1=2
(2x + y) dy =
fX jA (x) =
y=1=2
8
y2
8x + 1
2xy +
=
5
2 y=0
5
0x1
otherwise
(8x + 1)=5
(d) For 0 y 1=2, the conditional marginal PDF of Y given A is
fY jA (y) =
fX ;Y jA (x; y) dx =
=
=
The complete expression is
fY jA (y) =
(8y + 8)=5
8
5
Z 1
(2x + y) dx
0
x=1
8x2 + 8xy
5
8y + 8
5
0 y 1=2
otherwise
x=0
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
173
Problem 5.6.4
Y
fX ;Y (x; y) =
,1 x 1 0 y x2
5x2
2
otherwise
-1
(a) The event A = fY
P[A] = 2
=
1 4g has probability
=
Z 1=2 Z x2 2
5x
0
Z 1=2
5x4 dx +
dy dx + 2
Z 1
5x2
1=2
Z 1 Z 1=4 2
5x
1=2 0
dy dx
dx
Y<1/4
1=2
1
5
3
= x
+ 5x =12 1 = 19=48
=2
-1
This implies
fX ;Y jA (x; y) =
fX ;Y (x; y) =P[A] (x; y) 2 A
0
otherwise
120x2 =19 ,1 x 1; 0 y x2 ; y 1=4
0
otherwise
(b)
fY jA (y) =
=
Z 1
120x2
dx
fX ;Y jA (x; y) dx = 2 p
y 19
80
19 (1
, y3 2 ) 0 y 1
=
otherwise
(c) The conditional expectation of Y given A is
E [Y jA] =
Z 1=4
80
19
(1
,y
3=2
) dy =
80
19
y2 2y7=2
, 7
2
(d) To find fX jA (x), we can write
fX jA (x) =
fX ;Y jA (x; y) dy
! 1=4
65
=
532
0
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
174
However, when we substitute fX ;Y jA (x; y), the limits will depend on the value of x.
When jxj 1=2, we have
fX jA (x) =
Z x2
120x2
19
dy =
120x4
19
When ,1 x ,1=2 or 1=2 x 1,
fX jA (x) =
Z 1=4
120x2
19
dy =
30x2
19
The complete expression for the conditional PDF of X given A is
fX jA (x) =
8
30x2 =19
>
>
<
,1 x ,1 2
,1 2 x 1 2
1 2x1
=
120x4 =19
>
>
:
30x2 =19
otherwise
(e) The conditional mean of X given A is
E [X jA] =
Z 1 2
Z 1
,1 2 30x3
120x5
30x3
dx +
dx +
dx = 0
19
1 2 19
,1
,1 2 19
=
Problem 5.7.1
fX ;Y (x; y) =
(x + y)
0 x; y 1
otherwise
(a) The conditional PDF fX jY (xjy) is defined for all y such that 0 y 1.
(b) For 0 y 1
fX jY (x) =
fX ;Y (x; y)
fX (x)
(x + y)
= R
=
1
0 (x + y) dy
(x+y)
x+1=2
0x1
otherwise
(c) fY jX (yjx) is defined for all values of x in the interval [0; 1].
(d) For 0 x 1,
fY jX (y) =
fX ;Y (x; y)
fY (y)
(x + y)
= R
=
1
0 (x + y) dx
(x+y)
y+1=2
0y1
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
175
Problem 5.7.2
Random variables X and Y have joint PDF
Y
2 0yx1
0 otherwise
fX ;Y (x; y) =
(a) For 0 y 1,
fY (y) =
Z 1
fX ;Y (x; y) dx =
2 dx = 2(1 , y)
Also, for y < 0 or y > 1, fY (y) = 0. The complete expression for the marginal PDF
is
fY (y) =
2(1 , y) 0 y 1
0
otherwise
(b) By Theorem 5.13, the conditional PDF of X given Y is
fX jY (xjy) =
That is, since Y
1
1,y
yx1
otherwise
X 1, X is uniform over [y 1] when Y = y.
;
(c) The conditional expectation of X given Y
E [X jY
fX ;Y (x; y)
fY (y)
Z
= y] =
=y
x fX jY (xjy) dx =
Z 1
y
can be calculated as
x
1,y
dx =
x2
2(1 , y) y
1+y
2
In fact, since we know that the conditional PDF of X is uniform over [y; 1] when
Y = y, it wasnt really necessary to perform the calculation.
Problem 5.7.3
Random variables X and Y have joint PDF
Y
fX ;Y (x; y) =
2 0yx1
0 otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
(a) For 0 x 1, the marginal PDF for X satisfies
Z
fX (x) =
Note that fX (x) = 0 for x
marginal PDF of X is
<
176
Z x
fX ;Y (x; y) dy =
2 dy = 2x
0 or x > 1. Hence the complete expression for the
fX (x) =
(b) The conditional PDF of Y given X
fY jX (yjx) =
=x
2x 0 x 1
0 otherwise
is
fX ;Y (x; y)
fX (x)
=
1=x 0 y x
0
otherwise
(c) Given X = x, Y has a uniform PDF over [0; x] and thus has conditional
expected value
R
E [Y jX = x] = x=2. Another way to obtain this result is to calculate , y fY jX (yjx) dy.
Problem 5.7.4
We are told in the problem statement that if we know r, the number of feet a student
sits from the blackboard, then we also know that that students grade is a Gaussian random
variable with mean 80 , r and standard deviation r. This is exactly
fX jR (xjr) =
p1
2r2
e,(x,[80,r])
2r2
Problem 5.7.5
Random variables X and Y have joint PDF
Y
fX ;Y (x; y) =
1=2 ,1 x y 1
0
otherwise
1
-1
(a) For ,1 y 1, the marginal PDF of Y is
Z
fY (y) =
fX ;Y (x; y) dx =
1 y
dx = (y + 1)=2
2 ,1
The complete expression for the marginal PDF of Y is
fY (y) =
(y + 1)=2
,1 y 1
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
177
(b) The conditional PDF of X given Y is
fX jY (xjy) =
fX ;Y (x; y)
fY (y)
=
1
1+y
,1 x y
otherwise
(c) Given Y = y, the conditional PDF of X is uniform over [,1; y]. Hence the conditional
expected value is E [X jY = y] = (y , 1)=2.
Problem 5.7.6
We are given that the joint PDF of X and Y is
fX ;Y (x; y) =
(a) The marginal PDF of X is
p2
fX (x) = 2
1=(r2 ) 0 x2 + y2 r2
0
otherwise
(
,x2 1
dy =
r2
The conditional PDF of Y given X is
fY jX (yjx) =
fX ;Y (x; y)
fX (x)
=
2 r2 ,x2
r2
,r x r
otherwise
1=(2 r2 , x2 ) y2 r2 , x2
0
otherwise
(b) Given X = x, we observe that over the interval [, r2 , x2 ; r2 , x2 ], Y has a uniform PDF. Since the conditional PDF fY jX (yjx) is symmetric about y = 0,
E [Y jX
= x] = 0
Problem 5.8.1
X and Y are independent random variables with PDFs
fX (x) =
1
,x=3 x
3e
(a) To calculate P[X
>
0
fY (y) =
otherwise
1
,y=2 y
2e
0
otherwise
Y ], we use the joint PDF fX ;Y (x; y) = fX (x) fY (y).
ZZ
P[X
>
Y] =
x>y
Z
1
fX (x) fY (y) dx dy
Z
1
e,x=3 dx dy
2
y 3
Z
1 ,y=2 ,y=3
=
e
dy
e
0 2
Z
1 ,(1=2+1=3)y
1=2
e
=
dy =
1=2 + 2=3
0 2
=
e,y
3
7
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
178
(b) Since X and Y are exponential random variables with parameters X = 1=3 and Y =
1=2, Appendix A tells us that E [X ] = 1=X = 3 and E [Y ] = 1=Y = 2. Since X and
Y are independent, the correlation is E [XY ] = E [X ]E [Y ] = 6.
(c) Since X and Y are independent, Cov [X ; Y ] = 0.
Problem 5.8.2
(a) Since E [,X2 ] = ,E [X2 ], we can use Theorem 5.8 to write
E [X1 , X2 ] = E [X1 + (,X2 )] = E [X1 ] + E [,X2 ] = E [X1 ] , E [X2 ] = 0
(b) By Theorem 4.6(f), Var [,X2 ] = (,1)2 Var [X2] = Var [X2 ]. Since X1 and X2 are independent, Theorem 5.15 says that
Var [X1 , X2 ] = Var [X1 + (,X2 )] = Var [X1 ] + Var [,X2 ] = 2 Var [X ]
Problem 5.8.3
Random variables X1 and X2 are independent and identically distributed with the following PDF:
fX (x) =
x=2 0 x 2
0
otherwise
(a) Since X1 and X2 are identically distributed they will share the same CDF FX (x).
Z x
FX (x) =
,
fX x0 dx0 =
8
< 0
x0
x2 =4 0 x 2
:
1
x2
(b) Since X1 and X2 are independent, we can say that
P[X1 1; X2 1] = P[X1 1]P[X2 1] = FX1 (1) FX2 (1) = [FX (1)]2 =
(c) For W
= max(X1 ; X2 ),
FW (1) = P[max(X1 ; X2) 1] = P[X1 1; X2 1]
Since X1 and X2 are independent,
FW (1) = P[X1 1]P[X2 1] = [FX (1)]2 = 1=16
(d)
FW (w) = P[max(X1 ; X2) w] = P[X1 w; X2 w]
Since X1 and X2 are independent,
FW (w) = P[X1 w]P[X2 w] = [FX (w)]
8
< 0
=
w4 =16
1
w0
0w2
w2
1
16
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
179
Problem 5.8.4
X and Y are independent random variables with PDFs
fX (x) =
2x 0 x 1
0 otherwise
fY (y) =
3y2 0 y 1
0
otherwise
For the event A = fX > Y g, this problem asks us to calculate the conditional expectations
E [X jA] and E [Y jA]. We will do this using the conditional joint PDF fX ;Y jA (x; y). Since
X and Y are independent, it is tempting to argue that the event X > Y does not alter the
probability model for X and Y . Unfortunately, this is not the case. When we learn that
X > Y , it increases the probability that X is large and Y is small. We will see this when we
compare the conditional expectations E [X jA] and E [Y jA] to E [X ] and E [Y ].
(a) We can calculate the unconditional expectations, E [X ] and E [Y ], using the marginal
PDFs fX (x) and fY (y).
Z
E [X ] =
Z 1
fX (x) dx =
fY (y) dy =
E [Y ] =
0
Z 1
0
2x2 dx = 2=3
3y3 dy = 3=4
(b) First, we need to calculate the conditional joint PDF fX ;Y jA (x; yja) x; y. The first step
is to write down the joint PDF of X and Y :
fX ;Y (x; y) = fX (x) fY (y) =
6xy2 0 x 1; 0 y 1
0
otherwise
The event A has probability
ZZ
P[A] =
fX ;Y (x; y) dy dx
x>y
Z 1Z x
0
X>Y
6xy2 dy dx
Z 1
2x dx = 2=5
The conditional joint PDF of X and Y given A is
(
fX ;Y jA (x; y) =
=
2A
fX ;Y (x;y)
P[A]
(x; y)
otherwise
15xy2 0 y x 1
0
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
180
The triangular region of nonzero probability is a signal that given A, X and Y are no
longer independent. The conditional expected value of X given A is
E [X jA] =
Z Z
, ,
Z 1
= 15
x2
x fX ;Y jA (x; yja) x; y dy dx
Z x
Z 1
=5
y2 dy dx
x5 dx = 5=6
The conditional expected value of Y given A is
E [Y jA] =
Z Z
, ,
y fX ;Y jA (x; y) dy dx = 15
Z 1 Z x
y dy dx =
x
0
15
4
Z 1
x5 dx = 5=8
We see that E [X jA] > E [X ] while E [Y jA] < E [Y ]. That is, learning X > Y gives us a
clue that X may be larger than usual while Y may be smaller than usual.
Problem 5.8.5
This problem is quite straightforward. From Theorem 5.2, we can find the joint PDF of
X and Y is
fX ;Y (x; y) =
2 [FX (x) FY (y)]
x y
[ fX (x) FY (y)]
y
= fX (x) fY (y)
Hence, FX ;Y (x; y) = FX (x) FY (y) implies that X and Y are independent.
If X and Y are independent, then
fX ;Y (x; y) = fX (x) fY (y)
By Definition 5.2,
Z x Z y
FX ;Y (x; y) =
, ,
fX ;Y (u; v) dv du
Z y
Z x
fX (u) du
fY (v) dv
= FX (x) FX (x)
Problem 5.8.6
Random variables X and Y have joint PDF
fX ;Y (x; y) =
2 e,y 0 x y
0
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
181
For W = Y , X we can find fW (w) by integrating over the region indicated in the figure
below to get FW (w) then taking the derivative with respect to w. Since Y X , W = Y , X
is nonnegative. Hence FW (w) = 0 for w < 0. For w 0,
Y
FW (w) = 1 , P[W
>
w] = 1 , P[Y
>
X + w]
Z Z
,
0
x
,
w
= 1,e
=1
+w
2 e,y dy dx
X<Y<X+w
The complete expressions for the joint CDF and corresponding joint PDF are
FW (w) =
0
w<0
,
w
1,e
w0
fW (w) =
0
w<0
,
w
e
w0
Problem 5.8.7
(a) To find if W and X are independent, we must be able to factor the joint density
function fX ;W (x; w) into the product fX (x) fW (w) of marginal density functions. To
verify this, we must find the joint PDF of X and W . First we find the joint CDF.
x W w] = P[X x Y , X w] = P[X x Y X + w]
Since Y X , the CDF of W satisfies FX W (x w) = P[X x X Y X + w]. Thus,
for x 0 and w 0,
FX ;W (x; w) = P[X
Z x Z x0 +w
FX ;W (x; w) =
=
x0
Z x
0
Z x
=
=
2 e,y dy dx0
x
,(x0 +w)
,e
0
x0 +w
,
y
e 0
dx0
Y
{X<x}{X<Y<X+w}
,x0 dx0
+ e
0 x
e,(x +w) , e,x
,x )(1 , e,w )
= (1 , e
We see that FX ;W (x; w) = FX (x) FW (w). Moreover, by applying Theorem 5.2,
fX ;W (x; w) =
2 FX ;W (x; w)
x w
,x e,w = fX (x) fW (w)
= e
Since we have our desired factorization, W and X are independent.
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
182
(b) Following the same procedure, we find the joint CDF of Y and W .
w Y y] = P[Y , X w Y y] = P[Y X + w Y y]
The region of integration corresponding to the event fY x + w Y yg depends on
whether y w or y w. Keep in mind that although W = Y , X Y , the dummy
FW;Y (w; y) = P[W
<
arguments y and w of fW;Y (w; y) need not obey the same constraints. In any case, we
must consider each case separately. For y > w, the region of integration resembles
Y
{Y<y} {Y<X+w}
y
w
X
y-w
Thus for y > w, the integration is
FW;Y (w; y) =
Z y,w Z u+w
0
2 e,v dv du +
Z y,w h
y,w u
e,u , e,(u+w) du +
2 e,v dv du
Z y h
y,w
i y,w h
e,u + e,(u+w)
+
e,u
,
,w , we,y
= 1,e
=
Z y Z y
e,u , e,y du
, ue,y
i y
y,w
For y w,
Z yZ y
FW;Y (w; y) =
Z0 y h u
=
0
2 e,v dv du
i
,e,y + e,u du
w
y
,y , e,u y
= ,ue
=1
, (1 + y)e,y
The complete expression for the joint CDF is
8
< 1
, e,w , we,y
FW Y (w y) =
1 , (1 + y)e,y
:
;
{Y<y}
0wy
0yw
otherwise
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
183
Applying Theorem 5.2 yields
fW;Y (w; y) =
2 FW;Y (w; y)
w y
=
22 e,y 0 w y
0
otherwise
The joint PDF fW;Y (w; y) doesnt factor and thus W and Y are dependent.
Problem 5.8.8
We need to define the events A = fU
ug and B = fV vg. In this case,
FU V (u v) = P[AB] = P[B] , P[Ac B] = P[V v] , P[U u V v]
;
>
Note that U = min(X ; Y ) > u if and only if X > u and Y > u. In the same way, since
V = max(X ; Y ), V v if and only if X v and Y v. Thus
P[U
>
u; V
v] = P[X
u; Y
>
>
u; X
v Y v] = P[u
;
<
v u
;
<
v]
Thus, the joint CDF of U and V satisfies
FU ;V (u; v) = P[V
v] , P[U
>
u; V
v] = P[X v Y v] , P[u
;
<
v u
;
<
v]
Since X and Y are independent random variables,
FU ;V (u; v) = P[X v]P[Y v] , P[u < X v]P[u < X v]
= FX (v) FY (v) , (FX (v) , FX (u)) (FY (v) , FY (u))
= FX (v) FY (u) + FX (u) FY (v) , FX (u) FY (u)
The joint PDF is
fU ;V (u; v) =
=
=
2 FU ;V (u; v)
uv
[ fX (v) FY (u) + FX (u) fY (v)]
u
fX (u) fY (v) + fX (v) fY (v)
Problem 5.9.1
fX ;Y (x; y) = ce,(x
2 =8) (y2 =18)
The omission of any limits for the PDF indicates that it is defined over all x and y. We
know that fX ;Y (x; y) is in the form of the bivariate Gaussian distribution so we look to
Definition 5.10 and attempt to find values for Y , X , E [X ], E [Y ] and .
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
184
(a) First, we know that the constant is
c=
1
2X Y
1 , 2
Because the exponent of fX ;Y (x; y) doesnt contain any cross terms we know that
must be zero, and we are left to solve the following for E [X ], E [Y ], X , and Y :
x , E [X ]
X
2
=
x2
8
y , E [Y ]
Y
2
=
y2
18
From which we can conclude that
E [X ] = E [Y ] = 0
X
Putting all the pieces together, we find that c =
p
p8
18
1
24 .
(b) Since = 0, we also find that X and Y are independent.
Problem 5.9.2
2
2
fX ;Y (x; y) = ce,(2x ,4xy+4y )
Proceeding as in Problem 5.9.1 we attempt to find values for Y , X , E [X ], E [Y ] and .
(a) First, we try to solve the following equations
x , E [X ]
X
2
=
4(1 , 2 )x2
8(1 , 2 )y2
8(1 , 2 )
y , E [Y ] 2
Y
2
X Y
The first two equations yield E [X ] = E [Y ] = 0
(b) To find the correlation coefficient , we observe that
X
q
= 1=
4(1 ,
2 )
q
= 1=
8(1 , 2)
Using X and Y in the third equation yields = 1= 2.
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
185
(c) Since = 1= 2, now we can solve for X and Y .
X
= 1=
= 1=2
(d) From here we can solve for c.
c=
1
2X Y
1,
(e) X and Y are dependent because 6= 0.
Problem 5.9.3
From the problem statement, we learn that
2X
= Y = 0
2
= Y = 1
From Theorem 5.18, the conditional expectation of Y given X is
E [Y jX ] = Y (X ) = Y +
Y
(X , X ) = X
X
In the problem statement, we learn that E [Y jX ] = X =2. Hence = 1=2. From Definition 5.10, the joint PDF is
fX ;Y (x; y) =
p1
32
2
2
e,2(x ,xy+y )=3
Problem 5.9.4
The given joint PDF is
fX ;Y (x; y) = de,(a
2 x2 +bxy+c2 y2 )
In order to be an example of the bivariate Gaussian PDF given in Definition 5.10, we must
have
a2 =
c2 =
,
,
b=
X Y (1 , 2 )
2 )
22X (1
d=
1
2Y2 (1
, 2 )
1
2X Y
We can solve for X and Y , yielding
X
2 (1 , 2 )
= p
2(1 , 2 )
1 , 2
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
186
Thus,
b=
,
= ,2ac
X Y (1 , 2 )
Hence,
,b
2ac
This implies
d2 =
1
42 2X Y2 (1
, 2)a2c2 = a2 c2 , b2
= (1
2 )
Since jj 1, we see thatpjbj 2ac. Further, for any choice of a, b and c that meets this
constraint, choosing d = a2 c2 , b2 =4 yields a valid PDF.
Problem 5.9.5
From Equation (5.5), we can write the bivariate Gaussian PDF as
fX ;Y (x; y) =
p1
e,(x,X )
X 2
22X
p1
e,(y, Y (x))
Y 2
2 Y2
where
Y
Y (x) = Y + (x , X )
X
= Y
1 , 2
However, the definitions of Y (x) and Y are not particularly important for this exercise.
When we integrate the joint PDF over all x and y, we obtain
Z Z
, ,
fX ;Y (x; y) dx dy =
, X 2
Z
p1
e,(x,X )
22X
p1
e,(y, Y (x))
, Y 2
|
{z
2 Y2
dy dx
}
p1
, X 2
e,(x,X )
22X
dx
The marked integral equals 1 because for each value of x, it is the integral of a Gaussian
PDF of one variable over all possible values. In fact, it is the integral of the conditional
PDF fY jX (yjx) over all possible y. To complete the proof, we see that
Z Z
, ,
fX ;Y (x; y) dx dy =
p1
, X 2
e,(x,X )
22X
dx = 1
since the remaining integral is the integral of the marginal Gaussian PDF fX (x) over all
possible x.
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
187
Problem 5.10.1
The mean value of a sum of random variables is always the sum of their individual
means.
n
E [Y ] = E [Xi ] = 0
i=1
The variance of any sum of random variables can be expressed
in
terms of the individual
2
variances and co-variances. Since the E [Y ] is zero, Var [Y ] = E Y . Thus,
2
!2 3
Xi
Var [Y ] = E 4
"
5=E
i=1
Since E [Xi ] = 0, E Xi2
XiX j
i=1 j=1
= Var [Xi ] = 1
Thus, Var [Y ] = n + n(n , 1).
E Xi X j
and for i 6= j,
= Cov
Xi ; X j
E Xi2
i =1
i=1 j6=i
Xi X j
Problem 5.10.2
The best approach to this problem is find the complementary CDF of W . Since all Xi
are iid with PDF fX (x) x and CDF FX (x),
P[W
>
w] = P[min fX1 ; : : : ; Xn g > w]
= P[X1 > w]P[X2 > w] P[Xn > w]
= [1 , FX1 (w)][1 , FX2 (w)] [1 , FXn (w)]
n
= [1 , FX (w)]
The CDF is thus
FW (w) = 1 , P[W
>
w] = 1 , [1 , FX (w)]n
The PDF fW (w) can be found be taking the derivative with respect to w.
fW (w) = n[1 , FX (w)]n,1 fX (w)
Problem 5.10.3
In this problem, W = max(X1 ; : : : ; Xn) where all Xi are independent and identically
distributed. The CDF of W is
FW (w)
=
=
=
=
P[max fX1 ; : : : ; Xn g w]
P[X1 w]P[X2 w] : : : P[Xn w]
Fx1 (w) Fx2 (w) : : : Fxn (w)
n
[FX (w)]
And the PDF of W , fW (w) can be found be taking the derivative with respect to w
fW (w) = n [FX (w)]n,1 fX (w)
Yates and Goodman: Probability and Stochastic Processes Solutions Manual
188
Problem 5.10.4
Let A denote the event Xn = max(X1 ; : : : ; Xn ). We can find P[A] by conditioning on the
value of Xn .
P[A] = P[X1 Xn ; X2 Xn ; ; Xn1 Xn ]
Z
=
=
Z,
P[X1 < Xn ; X2 < Xn; ; Xn,1 < Xn jXn = x] fXn (x) dx
P[X1 < x; X2 < x; ; Xn,1 < x] fX (x) dx
Since X1 ; : : : ; Xn,1 are iid,
P[A] =
=
Z,
P[X1 x]P[X2 x] P[Xn,1 x] fX (x) dx
n,1
[FX (x)]
fX (x) dx
1
n
= [FX (x)]
n
,
1
= (1 , 0)
n
= 1=n
Not surprisingly, since the Xi are identical, symmetry would suggest that Xn is as likely as
any of the other Xi to be the largest. Hence P[A] = 1=n should not be surprising.
