T tests comparing two means t tests comparing two means.
Embed Size (px)
Transcript of T tests comparing two means t tests comparing two means.
t testscomparing two means
Overall Purpose A t-test is used to compare two average scores. Sample data are used to answer a question about population means. The population means and standard deviations are not known.
The Three Types There are three ways to use a t-test in a comparative educational study:
One sample t-test Independent t-test Dependent t-test
Independent t-test To compare two groups measured at the same time.
Treatment vs. Control at pre-test Treatment vs. Control at post-test Males vs. Females - ed. outcomes Hi vs. Lo coping skills stress outcomes
One sample t-test To compare a sample to a population, or one group measured at one point in time.
Local Sample vs. national norm Sample mean vs. some theoretically or practically meaningful cut point
Dependent t-test To compare one group to itself over time, or one group measured at two times.
Pre-test vs. post-test for one group The mean performance for the same group under two different drug dosage levels
Assumptions and Conditions Normality Homogeneity of Variance Independence of Observations Random Sampling Population Variance Not Known
Testing Assumptions NormalityHistograms and boxplotsVisual inspectionReasonably within sampling error of normal Homogeneity of VarianceSPSS gives you a testp < .05 means assumption not metIf not met, you separate variance estimate t-test
Identifying Conditions Independence of ObservationsNo score influences another scoreStudy design feature Random SamplingThis is a formal assumptionIt is also a study design feature Population Variance Not KnownSample data is used to make estimates of population parametersException is the test value for the One Sample t-test
Additional Considerations Confidence intervals can be used to test the same hypotheses.
There is a unique critical t value for each degrees of freedom condition.
Additional Considerations Random assignment is needed to make causal inferences when using the independent t-test.
If intact groups are compared, examine differences on potential confounding variables.
Statistical Significance How do you know when there is a statistically significant difference between the average scores you are comparing?
Statistical Significance When the p value is less than alpha, usually set at .05. What does a small p value mean?
Statistical Significance You are most interested in whether the amount of difference you observe in your sample means is more than would be expected due to sampling error alone.
Additional Considerations The z value of 1.96 serves as a rough guideline for evaluating a t value. It means that the amount of difference in the means is approximately twice as large as expected due to sampling error alone. Interpret the p value.
Statistical SignificanceIf the two population means are equal, your sample data can still show a difference due to sampling error.
The p value indicates the probability of results such as those obtained, or larger, given that the null hypothesis is true and only sampling error has lead to the observed difference.
Statistical Significance You have to decide which is a more reasonable conclusion: There is a real difference between the population means.Or The observed difference is due to sampling error.
Statistical Significance We call these conclusions: Rejecting the null hypothesis. Failing to reject the null hypothesis.
Statistical Significance If the p value is small, less than alpha (typically set at .05), then we conclude that the observed sample difference is unlikely to be the result of sampling error.
Statistical Significance If the p value is large, greater than or equal to alpha (typically set at .05), then we conclude that the difference you observed could have occurred by sampling error, even when the null hypothesis is true.
HypothesesHypotheses for the Independent t-testNull Hypothesis:m1 = m2 or m1 - m2 = 0Directional Alternative Hypothesis:m1 > m2 or m1 - m2 > 0Non-directional Alternative Hypothesis:m1 =/= m2 or m1 - m2 =/= 0where:m1 = population mean for group onem2 = population mean for group two
HypothesesHypotheses for the One Sample t-testNull Hypothesis:m = m0 or m - m0 = 0Directional Alternative Hypothesis:m > m0 or m - m0 > 0Non-directional Alternative Hypothesis:m =/= m0 or m - m0 =/= 0where:m = population mean for group of interest (local population)m0 = population mean for comparison (national norm)
ExampleOur sample research design:Head Start children randomly assigned to get in the program or be placed on the programs waiting list.Pre and Post test data collected on cognitive, social, and physical developmental outcomesMeasures scales with mean=50, SD=10.
ExampleOur sample research design:The subjects were not randomly sampled. They are volunteers. The parents of the study children applied for admission to Head Start in neighborhoods where more children apply than can be served.There are no other publicly funded preschool programs in the area for low income children.
ExampleOur sample research design: