Review & Hypothesis Testing

40
Recap of Normal Distribution Sampling Distribution Estimation Steps of Hypothesis Testing Hypothesis Testing

description

Central Limit Theorem, Confidence Intervals, and Basics of Hypothesis Tests

Transcript of Review & Hypothesis Testing

Page 1: Review & Hypothesis Testing

Recap of Normal DistributionSampling Distribution

EstimationSteps of Hypothesis Testing

Hypothesis Testing

Page 2: Review & Hypothesis Testing

Normal curve: brief review“Standardized scores” brief review

Z-scoresTransformed scores (e.g., T-score, IQ, SAT)

Sampling DistributionsEstimation: Confidence IntervalsHypothesis Testing

Agenda

Page 3: Review & Hypothesis Testing

Normal CurveAreasZ-scoresTransformed scores (e.g., T-scores)

Page 4: Review & Hypothesis Testing

Normal Distribution

Common shape in nature for many traitsSymmetrical distribution with one modeContains 100% of all cases in populationDetermined by two parameters:

Mean (center). Symbols: (pop.) and M (sample)

Standard Deviation (spread)Symbols: (pop.) and s (sample)Variance = 2 (pop) and s2 (sample)

Page 5: Review & Hypothesis Testing

Z-score for individual score:Transformed scores with new M, new s:New X = new M + (z)(new s) (Example: T scores)

Probability and Normal Distribution

s

X-MXz or

Page 6: Review & Hypothesis Testing

Z-score for individual score:Transformed scores with new M, new s:New X = new M + (z)(new s) (Examples: T scores, IQ, SAT and GRE, etc.)

Probability and Normal Distribution

s

MXXz

or

Page 7: Review & Hypothesis Testing

Sampling Distribution of the MeanShape of the distributionStandard Error

Page 8: Review & Hypothesis Testing

No longer dealing with individual scoresInstead, considering the behavior of a statistic

(computed on samples) relative to parameter in the population.

Sampling Distribution = distribution of that statistic if a very large (infinite) number of samples are drawn.

Can be distribution of mean, variance, median.

Sampling Distribution of the Mean is common.

Change of Perspective

Page 9: Review & Hypothesis Testing

Samples from Normal & Skewed Distributions

Page 10: Review & Hypothesis Testing

Samples drawn from Uniform and Irregular Distribution

Page 11: Review & Hypothesis Testing

Sampling Distribution of any Parameter

Bias and Variability Simulation

from the Estimation Chapter

Page 12: Review & Hypothesis Testing

When many samples are drawn, the distribution of their means is normal.

This is true regardless of the shape of the population’s distribution.

The Mean of the sampling distribution is equal to the Population Mean

Central Limit Theorem

NNN MM

222 or so

Page 13: Review & Hypothesis Testing

Variance of sampling distribution is equal to population variance divided by N (sample size)

Standard deviation of the sampling distribution is called the “Standard Error”(of the parameter). It is square root of the variance of the sampling distribution.

Variance and Standard Error

NNN MM

222 or so

Page 14: Review & Hypothesis Testing

EstimationPoint EstimatesInterval Estimates

Page 15: Review & Hypothesis Testing

Use our knowledge of sampling distribution to make a guess about the population when we only have information from a sample.

First examples are artificially simple: they give us the population standard deviation while we don’t know the population mean.

Estimation overview

Page 16: Review & Hypothesis Testing

The mean of the distribution of sample means is equal to the population mean .

The mean of the sampling distribution is called the expected value of the statistic

The sample mean is an unbiased estimator of the population mean .

Point Estimate

Page 17: Review & Hypothesis Testing

The mean of a single sample is an unbiased estimator of the population mean

The Standard Error of the Mean (when we know the population standard deviation ) gives us information about the expected deviation score of our sample mean M from the population parameter

We use this information, and the areas of the normal curve, to compute an interval estimate.

Interval Estimates

Page 18: Review & Hypothesis Testing

M = 30, = 9, N =25, 90% confidence intervalWe find z.90 from the Inverse Normal

Calculator (here) for the Unit Normal Curve (z = 1.6449 for a 90% confidence interval)

According to the Central Limit theorem, the middle 90% of sample means will be within1.6449 M of the population mean

Therefore, the probability that the population mean will be within 1.6449 M is also 90%

Sampling distribution example

Page 19: Review & Hypothesis Testing

An interval around the sample mean that is 1.6449 * M will contain 90% of the time.

Confidence Interval Simulator lets us see the effect of different sample sizes on intervals for 95% and 99% confidence (here)

Sampling distribution example (2)

Page 20: Review & Hypothesis Testing

Calculate the Standard Error of the Mean:M = /N = 9/ 25 = 9/5 = 1.80

Calculate Confidence Interval by hand: Lower limit = M – (1.6449*1.80) = 35-2.96082Upper limit = M + (1.6449*1.80) = 35+2.9608290% Confidence Interval

= [32.03918, 37.96082 ]

Sampling distribution example (3)

Page 21: Review & Hypothesis Testing

Remember: M is the Standard Deviation of the Sampling Distribution, so we will use M in the Inverse Normal Calculator.

Inverse Normal Calculator

Page 22: Review & Hypothesis Testing

Hypothesis TestingNull hypothesis and Alternate HypothesesReject a Null hypothesis when it is very unlikely

Page 23: Review & Hypothesis Testing

Logic of hypothesis test

1. State a null hypothesis about a population2. Predict the characteristics of the sample

based on the hypothesis3. Obtain a random sample from the population4. Compare the obtained sample data with the

prediction made from the hypothesis If consistent, hypothesis is reasonable If discrepant, hypothesis is rejected

Page 24: Review & Hypothesis Testing

Jury trial: an analogy• Trial begins with null hypothesis

(innocent until proven guilty).• Police and prosecutor gather evidence (data)

about probable innocence.• If there is sufficient evidence, jury rejects

innocence claim and concludes guilt.• If there is not enough evidence, jury fails to

convict (but does not conclude defendant is innocent).

Page 25: Review & Hypothesis Testing

Four steps of Hypothesis Testing

State the hypothesesNull hypothesis or H0

Alternate hypothesis or HA or H1

Set the criteria for a decisionPick an alpha level (.05 is common)

Collect data and compute sample statisticsNeed mean and standard deviation

Make a decision

Page 26: Review & Hypothesis Testing

Step 1: State hypothesesNull hypothesis (H0) states that, in the

general population, there is no change, no difference, or no relationship

Alternative hypothesis (H1) states that there is a change, a difference, or a relationship in the general population

Page 27: Review & Hypothesis Testing

Step 2: Set the criteria for decision

Distribution of sample means is dividedThose likely if H0 is trueThose very unlikely if H0 is true

Alpha level, or level of significance, is a probability value used to define “very unlikely”

Critical region is composed of the extreme sample values that are very unlikely

Boundaries of critical region are determined by alpha level.

Page 28: Review & Hypothesis Testing

Division of distribution of sample means

Page 29: Review & Hypothesis Testing

Critical regions for α = .05

Page 30: Review & Hypothesis Testing

Step 3: Collect data and Compute sample statistics

Data collected after hypotheses statedData collected after criteria for decision setThis sequence assures objectivity

Compute a sample statistic (z-score) to show the exact position of the sample.

Page 31: Review & Hypothesis Testing

Step 4: Make a decisionIf sample data are in

the critical region, the null hypothesis is rejected

If the sample data are not in the critical region, the researcher fails to reject the null hypothesis

Page 32: Review & Hypothesis Testing

Uncertainty and Errors in Hypothesis Testing

Hypothesis testing is an inferential processUses limited information to reach a general

conclusion, often leading to actionSample data used to draw conclusion

about a population that cannot be observed.

Errors are possible and probable

Page 33: Review & Hypothesis Testing

Type I and Type II Errors

Actual Situation

No EffectH0 True

Effect ExitsH0 False

Experimenter’s Decision

Reject H0 Type I error Decision correct

Retain H0 Decision correct Type II error

Page 34: Review & Hypothesis Testing

Location of critical region boundaries

Page 35: Review & Hypothesis Testing

Factors influencing hypothesis testSize of difference between sample mean

and original population meanAppears in numerator of the z-score

Variability of the scores Influences size of the standard error

Sample SizeInfluences size of the standard error

Page 36: Review & Hypothesis Testing

Directional (One-Tailed) Hypothesis Tests

In a two-tailed test, the critical region is divided on both tails of the distribution.

Researchers usually have a specific prediction about the direction of a treatment effect before they begin.

In a directional hypothesis or one-tailed test, the hypotheses specify an increase or decrease in the population mean

Page 37: Review & Hypothesis Testing

Critical region for One-Tailed Test

Page 38: Review & Hypothesis Testing

Video of an example (here)

Page 39: Review & Hypothesis Testing

Homework & QuizzesIt all makes sense when a teacher walks through it.The ideas become yours when you work with them.

Page 40: Review & Hypothesis Testing

Recap of Normal DistributionSampling Distribution

EstimationSteps of Hypothesis Testing

Hypothesis Testing