Standard error
description
Transcript of Standard error
![Page 1: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/1.jpg)
1
Standard error
Standard error
Estimated standard error ,s ,
)ˆ(Vˆ
ˆˆ )ˆ(se
nX
n
Sˆ X
![Page 2: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/2.jpg)
2
Example 1
While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power of 550W, the following 10 measurement of thermal conductivity ( in Btr/hr-ft-F) were obtained:
41.60 41.48 42.34 41.95 41.8642.18 41.72 42.26 41.81 42.04
Find point estimate of the mean conductivity and the estimated standard error.
![Page 3: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/3.jpg)
3
Mean square error
Definition:
Relative efficiency
2)ˆ(E)ˆ(MSE
2
22
)bias()ˆ(V
)]ˆ(E[)]ˆ(Eˆ[E)ˆ(MSE
)ˆ(MSE
)ˆ(MSE
2
1
![Page 4: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/4.jpg)
4
Maximum Likelihood Estimation
The Maximum Likelihood Estimate, of a parameter is the numerical value of for which the observed results in the data at hand would have the highest probability of arising.
![Page 5: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/5.jpg)
5
Example: Defect Rate
Suppose that we want to estimate the defect rate f in a production process. We learn that, in a random sample of 20 items that completed the process, 3 were found to be defective. Given only this outcome, we must estimate f.
![Page 6: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/6.jpg)
6
MLE Definition
The Maximum Likelihood Estimator, , is the value of that maximizes
L() = f(x1; ).f(x2; ). … .f(xn; ) Example: Bernoulli Example: Exponential Other examples in text: Normal
![Page 7: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/7.jpg)
7
Properties of MLE
In general, when the sample size n is large, and if is the MLE of : is an approx unbiased estimator for The variance of is almost as small as
that obtained by any other estimator has an approx normal distribution
])ˆ(E[
![Page 8: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/8.jpg)
8
The Invariance Property
Let be the MLE of 1, 2 ,…, k . Then the MLE of any function h(1, 2 ,…, k) of these parameters is the same function h( ) of the estimators.
k21ˆ , ... ,ˆ ,ˆ
k21ˆ , ... ,ˆ ,ˆ
![Page 9: Standard error](https://reader036.fdocuments.us/reader036/viewer/2022082819/56813dd0550346895da79a59/html5/thumbnails/9.jpg)
9
MLE vs. unbiased estimation
What is the difference between MLE and unbiased estimation?
Can a procedure meet one standard and not the other?
Example: uniform distribution on [0,a].