Applied Statistics and Probability for Engineersie230.cankaya.edu.tr/uploads/files/ch05.pdf · 1....
Transcript of Applied Statistics and Probability for Engineersie230.cankaya.edu.tr/uploads/files/ch05.pdf · 1....
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Chapter 5Joint Probability Distributions
Applied Statistics and Probability for
Engineers
Sixth Edition
Douglas C. Montgomery George C. Runger
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Chapter 5 Title and Outline2
5Joint Probability
Distributions
5-1 Two or More Random Variables
5-1.1 Joint Probability Distributions
5-1.2 Marginal Probability Distributions
5-1.3 Conditional Probability Distributions
5-1.4 Independence
5-1.5 More Than Two Random Variables
5-2 Covariance and Correlation
5-3 Common Joint Distributions
5-3.1 Multinomial Probability Distribution
5-3.2 Bivariate Normal Distribution
5-4 Linear Functions of Random Variables
5-5 General Functions of Random Variables
5-6 Moment Generating Functions
CHAPTER OUTLINE
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Learning Objectives for Chapter 5
After careful study of this chapter, you should be able to do the
following:1. Use joint probability mass functions and joint probability density
functions to calculate probabilities.
2. Calculate marginal and conditional probability distributions from joint probability distributions.
3. Interpret and calculate covariances and correlations between random variables.
4. Use the multinomial distribution to determine probabilities.
5. Properties of a bivariate normal distribution and to draw contour plots for the probability density function.
6. Calculate means and variances for linear combinations of random variables, and calculate probabilities for linear combinations of normally distributed random variables.
7. Determine the distribution of a general function of a random variable.
8. Calculate moment generating functions and use them to determine moments and distributions
3Chapter 5 Learning Objectives
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Joint Probability Mass Function
Sec 5-1.1 Joint Probability Distributions 4
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Joint Probability Density Function
Sec 5-1.1 Joint Probability Distributions 5
Figure 5-2 Joint probability
density function for the random
variables X and Y. Probability
that (X, Y) is in the region R is
determined by the volume of
fXY(x,y) over the region R.
The joint probability density function for the continuous
random variables X and Y, denotes as fXY(x,y), satisfies the
following properties:
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-2: Server Access Time-1Let the random variable X denote the time until a computer
server connects to your machine (in milliseconds), and let Y
denote the time until the server authorizes you as a valid user (in
milliseconds). X and Y measure the wait from a common
starting point (x < y). The joint probability density function for X
and Y is
Sec 5-1.1 Joint Probability Distributions 6
Figure 5-4 The joint probability
density function of X and Y is
nonzero over the shaded region
where x < y.
0.001 0.002 6, for 0 and 6 10x y
XYf x y ke x y k
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-2: Server Access Time-2
The region with nonzero probability is shaded in
Fig. 5-4. We verify that it integrates to 1 as follows:
Sec 5-1.1 Joint Probability Distributions 7
0.001 0.002 0.002 0.001
0 0 0 0
0.0020.001 0.003
0 0
,
0.0030.002
10.003 1
0.003
x y y x
XY
xx x
f x y dydx ke dy dx k e dy e dx
ek e dx e dx
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-2: Server Access Time-3
Now calculate a probability:
Sec 5-1.1 Joint Probability Distributions 8
Figure 5-5 Region of
integration for the probability
that X < 1000 and Y < 2000
is darkly shaded.
1000 2000
0
1000 2000
0.002 0.001
0
1000 0.002 40.001
0
1000
0.003 4 0.001
0
3 14
1000, 2000 ,
0.002
0.003
1 10.003
0.003 0.001
XY
x
y x
x
xx
x x
P X Y f x y dydx
k e dy e dx
e ek e dx
e e e dx
e ee
0.003 316.738 11.578 0.915
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Marginal Probability Distributions (discrete)
The marginal probability distribution for X is found by summing the probabilities
in each column whereas the marginal probability distribution for Y is found by
summing the probabilities in each row.
Sec 5-1.2 Marginal Probability Distributions 9
X
y
Y
x
f x f xy
f y f xy
1 2 3 f (y )
1 0.01 0.02 0.25 0.28
2 0.02 0.03 0.20 0.25
3 0.02 0.10 0.05 0.17
4 0.15 0.10 0.05 0.30
f (x ) 0.20 0.25 0.55 1.00
y = Response
time(nearest
second)
x = Number of Bars of
Signal Strength
Marginal probability distributions of X and Y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Marginal Probability Density Function (continuous)
If the joint probability density function of
random variables X and Y is fXY(x,y), the
marginal probability density functions of X
and Y are:
Sec 5-1.2 Marginal Probability Distributions 10
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-4: Server Access Time-1
For the random variables that
denotes times in Example 5-2,
find the probability that Y
exceeds 2000 milliseconds.
Integrate the joint PDF directly
using the picture to determine
the limits.
Sec 5-1.2 Marginal Probability Distributions 11
2000
0 2000 2000
2000 , ,
Dark region left dark region right dark region
XY XY
x
P Y f x y dy dx f x y dy dx
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-4: Server Access Time-2
Alternatively, find the marginal PDF and then
integrate that to find the desired probability.
Sec 5-1.2 Marginal Probability Distributions 12
0.001 0.002
0
0.002 0.001
0
0.0010.002
0
0.0010.002
3 0.002 0.001
0.001
1
0.001
6 10 1 for 0
y
x y
Y
y
y x
yx
y
yy
y y
f y ke dx
ke e dx
eke
eke
e e y
2000
3 0.002 0.001
2000
0.002 0.0033
2000 2000
4 63
2000
6 10 1
6 100.002 0.003
6 10 0.050.002 0.003
Y
y y
y y
P Y f y dy
e e dy
e e
e e
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Mean & Variance of a Marginal Distribution
E(X) and V(X) can be obtained by first calculating the marginal
probability distribution of X and then determining E(X) and V(X) by
the usual method.
Sec 5-1.2 Marginal Probability Distributions 13
2 2
2 2
X
R
X X
R
Y
R
Y Y
R
E X x f x
V X x f x
E Y y f y
V Y y f y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Mean & Variance for Example 5-1
Sec 5-1.2 Marginal Probability Distributions 14
1 2 3
1 0.01 0.02 0.25 0.28 0.28 0.28
2 0.02 0.03 0.20 0.25 0.50 1.00
3 0.02 0.10 0.05 0.17 0.51 1.53
4 0.15 0.10 0.05 0.30 1.20 4.80
f (x ) 0.20 0.25 0.55 1.00 2.49 7.61
x *f (x ) 0.20 0.50 1.65 2.35
x 2*f (x ) 0.20 1.00 4.95 6.15
y 2*f (y )
x = Number of Bars
of Signal Strength
y = Response
time(nearest
second)
f (y ) y *f (y )
E(X) = 2.35 V(X) = 6.15 – 2.352 = 6.15 – 5.52 = 0.6275
E(Y) = 2.49 V(Y) = 7.61 – 2.492 = 7.61 – 16.20 = 1.4099
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Conditional Probability Density Function
Sec 5-1.3 Conditional Probability Distributions 15
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-6: Conditional Probability-1From Example 5-2, determine the conditional PDF for Y given X=x.
Sec 5-1.3 Conditional Probability Distributions 16
0.001 0.002
0.0020.001
0.0020.001
0.003
0.001 0.002
0.003
0.002 0.002
0.002
0.002
0.003 for 0
,
( ) 0.003
0.002 for 0
x y
X
x
yx
x
x
x
x yXY
Y x x
X
x y
f x k e dy
eke
eke
e x
f x y kef y
f x e
e x and x y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-6: Conditional Probability-2
Now find the probability that Y exceeds 2000 given that X=1500:
Sec 5-1.3 Conditional Probability Distributions 17
1500
2000
0.002 1500 0.002
2000
0.0023
2000
43 1
2000 1500
0.002
0.0020.002
0.002 0.3680.002
Y
y
y
P Y X
f y dy
e
ee
ee e
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Mean & Variance of Conditional Random Variables
• The conditional mean of Y given X = x,
denoted as E(Y|x) or μY|x is
• The conditional variance of Y given X = x,
denoted as V(Y|x) or σ2Y|x is
Sec 5-1.3 Conditional Probability Distributions 18
Y x
y
E Y x y f y
2
2 2
Y x Y x Y x Y x
y y
V Y x y f y y f y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-8: Conditional Mean And Variance
From Example 5-2 & 5-6, what is the conditional mean for
Y given that x = 1500?
Sec 5-1.3 Conditional Probability Distributions 19
0.002 1500 0.002 3 0.002
1500 1500
0.002 0.0023
15001500
0.0023 3
1500
3
1500 0.002 0.002
0.0020.002 0.002
15000.002
0.002 0.002 0.002
0.002
y y
y y
y
E Y X y e dy e y e dy
e ee y dy
ee e
e
33
33
1500
0.002 0.002 0.002
0.002 2000 20000.002
ee
ee
If the connect time is 1500 ms, then the expected time to be authorized is 2000 ms.
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-9For the discrete random variables in Exercise 5-1,
what is the conditional mean of Y given X=1?
Sec 5-1.3 Conditional Probability Distributions 20
1 2 3
1 0.01 0.02 0.25 0.28
2 0.02 0.03 0.20 0.25
3 0.02 0.10 0.05 0.17
4 0.15 0.10 0.05 0.30
f (x ) 0.20 0.25 0.55 y*f(y|x=1) y2*f(y|x=1)
1 0.050 0.080 0.455 0.05 0.05
2 0.100 0.120 0.364 0.20 0.40
3 0.100 0.400 0.091 0.30 0.90
4 0.750 0.400 0.091 3.00 12.00
Sum of f(y|x) 1.000 1.000 1.000 3.55 13.35
12.6025
0.7475
f (y )y = Response
time(nearest
second)
x = Number of Bars
of Signal Strength
The mean number of attempts given one bar is 3.55 with variance of 0.7475.
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Independent Random Variables
For random variables X and Y, if any one of the
following properties is true, the others are also true.
Then X and Y are independent.
Sec 5-1.4 Independence 21
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-11: Independent Random Variables
• Suppose the Example 5-2 is modified such that the joint
PDF is:
• Are X and Y independent?
• Find the probability
Sec 5-1.4 Independence 22
6 0.001 0.002, 2 10 for 0 and 0.x y
XYf x y e x y
6 0.001 0.002
0
0.001
2 10
0.001 for 0
x y
X
x
f x e dy
e x
6 0.001 0.002
0
0.002
2 10
0.002 for y > 0
x y
Y
y
f y e dx
e
1 2
1000, 1000 1000 1000
1 0.318
P X Y P X P Y
e e
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Joint Probability Density Function
Sec 5-1.5 More Than Two Random Variables 23
The joint probability density function for the continuous
random variables X1, X2, X3, …Xp, denoted as
satisfies the following properties: 1 2 ... 1 2, ,...,
pX X X pf x x x
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-14: Component Lifetimes
In an electronic assembly, let X1, X2, X3, X4 denote
the lifetimes of 4 components in hours. The joint
PDF is:
What is the probability that the device operates
more than 1000 hours?
The joint PDF is a product of exponential PDFs.
P(X1 > 1000, X2 > 1000, X3 > 1000, X4 > 1000)
= e-1-2-1.5-3 = e-7.5 = 0.00055
Sec 5-1.5 More Than Two Random Variables 24
1 2 3 4
1 2 3 4
0.001 0.002 0.0015 0.00312
1 2 3 4, , , 9 10 for x 0x x x x
X X X X if x x x x e
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Marginal Probability Density Function
Sec 5-1.5 More Than Two Random Variables 25
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Mean & Variance of a Joint Distribution
The mean and variance of Xi can be
determined from either the marginal PDF, or
the joint PDF as follows:
Sec 5-1.5 More Than Two Random Variables 26
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-16Points that have positive probability in the
joint probability distribution of three random
variables X1 , X2 , X3 are shown in Figure.
Suppose the 10 points are equally likely
with probability 0.1 each. The range is the
non-negative integers with x1+x2+x3 = 3
List the marginal PDF of X2
Sec 5-1.5 More Than Two Random Variables 27
P (X2 = 0) = (3,0,0) + (0,0,3) + (1,0,2) + (2,0,1) = 0.4
P (X2 = 1) = (2,1,0) + (0,1,2) + (1,1,1) = 0.3
P (X2 = 2) = (1,2,0) + (0,2,1) = 0.2
P (X2 = 3) = (0,3,0) = 0.1
321 xxxf 321 xxxf 321 xxxf 321 xxxf
321 xxxf321 xxxf 321 xxxf
321 xxxf 321 xxxf
321 xxxf
Also, E(x2) = 0(0.4) + 1(0.3) + 2(0.2) + 3(0.1) = 1
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Distribution of a Subset of Random Variables
Sec 5-1.5 More Than Two Random Variables 28
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Conditional Probability Distributions
• Conditional probability distributions can be
developed for multiple random variables by
extension of the ideas used for two random
variables.
• Suppose p = 5 and we wish to find the
distribution conditional on X4 and X5.
Sec 5-1.5 More Than Two Random Variables 29
1 2 3 4 5
1 2 3 4 5
4 5
4 5
1 2 3 4 5
1 2 3
4 5
4 5
, , , ,, ,
,
for , 0.
X X X X X
X X X X X
X X
X X
f x x x x xf x x x
f x x
f x x
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Independence with Multiple Variables
The concept of independence can be extended to
multiple variables.
Sec 5-1.5 More Than Two Random Variables 30
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-18: Layer ThicknessSuppose X1,X2, and X3 represent the thickness in μm of a
substrate, an active layer and a coating layer of a chemical
product. Assume that these variables are independent and
normally distributed with parameters and specified limits as
tabled.
Sec 5-1.5 More Than Two Random Variables 31
X 1 X 2 X 3
Mean (μ) 10,000 1,000 80
Std dev (σ) 250 20 4
Lower limit 9,200 950 75
Upper limit 10,800 1,050 85
P(in limits) 0.99863 0.98758 0.78870
0.77783P(all in limits) =
Normal
Random VariablesParameters
and specified
limits
What proportion of the product
meets all specifications?
Answer: 0.7783, 3 layer product.
Which one of the three
thicknesses has the least
probability of meeting specs?
Answer: Layer 3 has least prob.
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Covariance
• Covariance is a measure of the relationship between two random variables.
• First, we need to describe the expected value of a function of two random variables. Let h(X, Y) denote the function of interest.
Sec 5-2 Covariance & Correlation 32
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-19: Expected Value of a Function of Two Random Variables
Sec 5-2 Covariance & Correlation 33
For the joint probability distribution of the two random variables in
Example 5-1, calculate E [(X-μX)(Y-μY)].
The result is obtained by multiplying x - μX times y - μY, times fxy(X,Y)
for each point in the range of (X,Y). First, μX and μy were determined
previously from the marginal distributions for X and Y:
μX = 2.35 and μy = 2.49
Therefore,
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Covariance Defined
Sec 5-2 Covariance & Correlation 34
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Correlation (ρ = rho)
Sec 5-2 Covariance & Correlation 35
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-21: Covariance & Correlation
Determine the covariance
and correlation to the figure
below.
Sec 5-2 Covariance & Correlation 36
x y f(x, y) x-μX y-μY Prod
0 0 0.2 -1.8 -1.2 0.42
1 1 0.1 -0.8 -0.2 0.01
1 2 0.1 -0.8 0.8 -0.07
2 1 0.1 0.2 -0.2 0.00
2 2 0.1 0.2 0.8 0.02
3 3 0.4 1.2 1.8 0.88
0 0.2 1.260
1 0.2 0.926
2 0.2
3 0.4
0 0.2
1 0.2
2 0.2
3 0.4
μX = 1.8
μY = 1.8
σX = 1.1662
σY = 1.1662StD
ev
correlation =
Mar
gin
al
covariance =
Mea
n
Note the strong
positive correlation.
Join
t
Figure 5-13 Discrete joint
distribution, f(x, y).
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Independence Implies ρ = 0
• If X and Y are independent random
variables,
σXY = ρXY = 0
• ρXY = 0 is necessary, but not a sufficient
condition for independence.
Sec 5-2 Covariance & Correlation 37
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-23: Independence Implies Zero Covariance
Sec 5-2 Covariance & Correlation 38
Let 16 for 0 2 and 0 4
Show that 0
XY
XY
f xy x y x y
E XY E X E Y
Figure 5-15 A planar
joint distribution.
4 2
2 2
0 0
24 32
0 0
4
2
0
43
0
1
16
1
16 3
1 8
16 3
1 1 64 32
6 3 6 3 9
.
32 4 80
9 3 3
XY
E XY x y dx dy
xy dy
y dy
y
E XY E X E Y
4 2
2
0 0
24 3
0 0
42
0
4 2
2
0 0
24 22
0 0
43
0
1
16
1
16 3
1 8 1 16 4
16 2 3 6 2 3
1
16
1
16 2
2 1 64 8
16 3 8 3 3
E X x ydx dy
xy dy
y
E Y xy dx dy
xy dy
y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Multinomial Probability Distribution
• Suppose a random experiment consists of a series of n trials. Assume that:1) The outcome of each trial can be classifies into one of k
classes.
2) The probability of a trial resulting in one of the k outcomes is constant, and equal to p1, p2, …, pk.
3) The trials are independent.
• The random variables X1, X2,…, Xk denote the number of outcomes in each class and have a multinomial distribution and probability mass function:
Sec 5-3.1 Multinomial Probability Distribution 39
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-25: Digital Channel
Of the 20 bits received over a digital channel, 14 are of excellent
quality, 3 are good, 2 are fair, 1 is poor. The sequence received was
EEEEEEEEEEEEEEGGGFFP. Let the random variables X1 , X2 , X3,
and X4 denote the number of bits that are E, G, F , and P, respectively,
in a transmission of 20 bits. What is the probability that 12 bits are E, 6
bits are G, 2 are F, and 0 are P?
Sec 5-3.1 Multinomial Probability Distribution 40
12 6 2 0
1 2 3 4
20!12,X 6,X 2,X 0 0.6 0.3 0.08 0.02 0.0358
12!6!2!0!P X
0.03582 = (FACT(20)/(FACT(12)*FACT(6)*FACT(2))) * 0.6^12*0.3^6*0.08^2
Using Excel
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Multinomial Mean and Variance
The marginal distributions of the multinomial
are binomial.
If X1, X2,…, Xk have a multinomial distribution,
the marginal probability distributions of Xi is
binomial with:
E(Xi) = npi and V(Xi) = npi(1-pi)
Sec 5-3.1 Multinomial Probability Distribution 41
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Bivariate Normal Probability Density Function
Sec 5-3.2 Bivariate Normal Distribution 42
2
2 2
2 22
1, ; , , , ,
2 1
21where
2 1
for and .
u
XY X X Y Y
X Y
X X Y Y
X X Y Y
f x y e
x x y yu
x y
0, ,Parameter limits: 1 1
0, ,
x x
y y
The probability density function of a bivariate normal distribution is
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Marginal Distributions of the Bivariate Normal Random Variables
If X and Y have a bivariate normal distribution with
joint probability density function
fXY(x,y;σX,σY,μX,μY,ρ)
the marginal probability distributions of X and Y
are normal with means μX and μY and standard
deviations σX and σY, respectively.
Sec 5-3.2 Bivariate Normal Distribution 43
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Conditional Distribution of Bivariate Normal Random Variables
If X and Y have a bivariate normal distribution with
joint probability density fXY(x,y;σX,σY,μX,μY,ρ), the
conditional probability distribution of Y given X = x is
normal with mean and variance as follows:
Sec 5-3.2 Bivariate Normal Distribution 44
2 2 21
YY XY x
X
YY x
x
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Correlation of Bivariate Normal Random Variables
If X and Y have a bivariate normal
distribution with joint probability density
function fXY(x,y;σX,σY,μX,μY,ρ), the
correlation between X and Y is ρ.
Sec 5-3.2 Bivariate Normal Distribution 45
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Bivariate Normal Correlation and Independence
• In general, zero correlation does not imply independence.
• But in the special case that X and Y have a bivariate normal distribution, if ρ = 0, then X and Y are independent.
If X and Y have a bivariate normal
distribution with ρ=0, X and Y are
independent.
Sec 5-3.2 Bivariate Normal Distribution 46
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Linear Functions of Random Variables
• A function of random variables is itself a random variable.
• A function of random variables can be formed by either linear or nonlinear relationships. We limit our discussion here to linear functions.
• Given random variables X1, X2,…,Xp and constants c1, c2, …, cp
Y= c1X1 + c2X2 + … + cpXp
is a linear combination of X1, X2,…,Xp.
Sec 5-4 Linear Functions of Random Variables 47
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Mean and Variance of a Linear Function
If X1, X2,…,Xp are random variables, and Y= c1X1 + c2X2 +
… + cpXp , then
Sec 5-4 Linear Functions of Random Variables 48
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-31: Error Propagation
A semiconductor product consists of three layers.
The variances of the thickness of each layer is 25,
40 and 30 nm. What is the variance of the finished
product?
Answer:
Sec 5-4 Linear Functions of Random Variables 49
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Mean and Variance of an Average
Sec 5-4 Linear Functions of Random Variables 50
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Reproductive Property of the Normal Distribution
Sec 5-4 Linear Functions of Random Variables 51
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-32: Linear Function of Independent Normal Random variables
Let the random variables X1 and X2 denote
the length and width of a manufactured
part. Their parameters are shown in the
table. What is the probability that the
perimeter exceeds 14.5 cm?
Sec 5-4 Linear Functions of Random Variables 52
X 1 X 2
Mean 2 5
Std Dev 0.1 0.2
Parameters of
1 2
1 2
2 22 2
1 2
Let 2 2 perimeter
2 2 2 2 2 5 14 cm
2 2 4 0.1 4 0.2 0.04 0.16 0.20
0.20 0.4472 cm
14.5 1414.5 1 1 1.1180 0.1318
.4472
Y X X
E Y E X E X
V Y V X V X
SD Y
P Y
0.1318 = 1 - NORMDIST(14.5, 14, SQRT(0.2), TRUE)
Using Excel
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
General Function of a Discrete Random Variable
Suppose that X is a discrete random variable with probability distribution fX(x). Let Y = h(X) define a one-to-one transformation between the values of Xand Y so that the equation y = h(x) can be solved uniquely for x in terms of y. Let this solution be x = u(y), the inverse transform function. Then the probability mass function of the random variable Y is
fY(y) = fX[u(y)]
Sec 5-5 General Functions of Random Variables 53
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-34: Function of a Discrete Random Variable
Let X be a geometric random variable with probability
distribution
fX(x) = p(1-p)x-1 , x = 1, 2, …
Find the probability distribution of Y = X2.
Solution:
– Since X ≥ 0, the transformation is one-to-one.
– The inverse transform function is X = .
– fY(y) = p(1-p) -1 , y = 1, 4, 9, 16,…
Sec 5-5 General Functions of Random Variables 54
y
y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
General Function of a Continuous Random Variable
Suppose that X is a continuous random variable with probability distribution fX(x). Let Y = h(X) define a one-to-one transformation between the values of X and Y so that the equation y = h(x) can be solved uniquely for x in terms of y. Let this solution be x = u(y), the inverse transform function. Then the probability distribution of Y is
fY(y) = fX[u(y)]∙|J|
where J = u’(y) is called the Jacobian of the transformation and the absolute value of J is used.
Sec 5-5 General Functions of Random Variables 55
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-35: Function of a Continuous Random Variable
Let X be a continuous random variable with probability
distribution:
Find the probability distribution of Y = h(X) = 2X + 4
Sec 5-5 General Functions of Random Variables 56
( ) for 0 48
X
xf x x
Note that has a one-to-one relationship to .
4 1 and the Jacobian is '
2 2
4 2 1 4 for 4 12.
8 2 32Y
Y X
yx u y J u y
y yf y y
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Definition of Moments about the Origin
Sec 5-6 Moment Generating Functions 57
The rth moment about the origin of the
random variable X is
( ), discrete
' ( )( ) , continuous
r
r
r r
X f x X
E XX f x dx X
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Definition of a Moment-Generating Function
Sec 5-6 Moment Generating Functions 58
The moment-generating function of the random variable X is
the expected value of etX and is denoted by MX (t). That is,
( ), discrete
( ) ( )( ) , continuous
tX
tX
X tX
e f x X
M t M ee f x dx X
Let X be a random variable with moment-generating
function MX (t). Then
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-36 Moment-Generating Function for a Binomial Random Variable-1
Sec 5-6 Moment Generating Functions 59
Let X follows a binomial distribution, that is
Determine the moment generating function and use it to verify that the
mean and variance of the binomial random variable are μ=np and
σ2=np(1-p).
( ) (1 ) , 0,1,....,x n xn
f x p p x nx
Now the first and second order derivatives will be
0 0
( ) (1 ) ( ) (1 )n n
tx x n x t x n x
X
x x
n nM t e p p pe p
x x
The moment-generating function is
which is the binomial expansion of
[ (1 )]t npe p
' 1
'' 2
( ) [1 ( 1)] and
( ) (1 )[1 ( 1)]
t t n
x
t t t n
x
M t npe p e
M t npe p npe p e
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-36 Moment-Generating Function for a Binomial Random Variable-2
Sec 5-6 Moment Generating Functions 60
If we set t = 0 in the above two equations we get
' '
1
'' '
2
( ) and
( ) (1 )
x
x
M t np
M t np p np
Now the variance is
2 ' 2 2
2
2
(1 ) ( )
(1 )
np p np np
np np
np p
2Hence, the mean is and variance is (1 ).np np p
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Properties of Moment-Generating Function
Sec 5-6 Moment Generating Functions 61
1 2
1 2
1. ( ) ( )
2. ( ) ( )
If , ,..., are independent random vari
If is a random variable
ables with
moment generat
and is a co
ing functions ( ), ( ),...,
nstant, then
( )
respectiv
n
at
X a X
aX X
n
X X X
M t e M t
M t M at
X X X
M t M t M t
X a
1 2
1 2ely, and if ... then the moment
generating function of Y is
3. ( ) ( ). ( ). ... . ( )n
n
Y X X X
Y X X X
M t M t M t M t
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Example 5-38 Distribution of a Sum of Poisson Random Variables
Sec 5-6 Moment Generating Functions 62
Suppose that X1 and X2 are two independent Poisson random variables
with parameters λ1 and λ2, respectively. Determine the probability
distribution of Y = X1 + X2.
Using , the moment-generating
function of Y = X1 + X2 is
( 1)( )te
XM t e
The moment-generating function of a Poisson random variable with
parameter λ is
Hence for X1 and X2,1 2
1 2
( 1) ( 1)( ) and ( )
t te e
X XM t e M t e
1 2
1 2
1 2
( 1) ( 1)
( )( 1)
( ) ( ). ( )
t t
t
Y X X
e e
e
M t M t M t
e e
e
1 2( ) ( ). ( ). ... . ( )
nY X X XM t M t M t M t
Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Important Terms & Concepts for Chapter 5
Bivariate distribution
Bivariate normal distribution
Conditional mean
Conditional probability density
function
Conditional probability mass
function
Conditional variance
Contour plots
Correlation
Covariance
Error propagation
General functions of random
variables
Independence
Joint probability density function
Joint probability mass function
Linear functions of random
variables
Marginal probability distribution
Multinomial distribution
Reproductive property of the
normal distribution
Chapter 5 Summary 63