Causal (1)

64
8/13/2019 Causal (1) http://slidepdf.com/reader/full/causal-1 1/64 Educational Research: Causal-Comparative Studies EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.

Transcript of Causal (1)

Page 1: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 1/64

Educational Research:Causal-Comparative Studies

EDU 8603

Educational Research

Richard M. Jacobs, OSA, Ph.D.

Page 2: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 2/64

Research...

The systematic application of afamily of methods employed toprovide trustworthy informationabout problems…an ongoing process based on many

accumulated understandings andexplanations that, when taken togetherlead to generalizations about problemsand the development of theories

Page 3: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 3/64

The basic steps of research...

Scientific and disciplined inquiry is anorderly process, involving:

description and execution of

procedures to collection information(“method ”) objective data analysis

statement of findings (“ results ”)

recognition and

identification of atopic to be studied (“ problem ”)

Page 4: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 4/64

Research methods...

Quantitative …

…collects and analyzes numerical data obtained from formal instruments

Page 5: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 5/64

Quantitative methods...

descriptive research (“survey research”)

correlational researchcausal-comparative research (“ex p os t fac to research”)

experimental research

Page 6: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 6/64

causal- comparative research (“ ex p os tfacto research”)…at least two different groups are

compared on a dependent variable or measure of performance (called

the “effect”) because theindependent variable (called the“cause”) has already occurred or

cannot be manipulated

Page 7: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 7/64

Page 8: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 8/64

dependent variable …

…the change or difference occurringas a result of the independentvariable

…(syn.) criterion variable, effect,outcome, posttest

Page 9: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 9/64

A causal- comparative study…

…a study in which the researcher

attempts to determine the cause, orreason, for pre-existing differences ingroups of individuals

…called an “ ex p os t fac to ” studybecause both the effect and thealleged cause have already occurredand must be studied in retrospect

Page 10: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 10/64

Differences in causal-comparisonand correlational studies…

causal- comparative studies… …attempt to identify cause -effect

relationshipscorrelational studies… …attempt to identify relationships

Page 11: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 11/64

Page 12: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 12/64

Page 13: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 13/64

Differences in causal-comparisonand experimental studies…

causal- comparative studies… …individuals are not randomly selected but

selected because they belong to groupsexperimental studies… …individuals are randomly selected and

assigned to two (or more) groups

Page 14: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 14/64

causal- comparative studies… …the researcher cannot manipulate the

independent variableexperimental studies… …the researcher manipulates the

independent variable

Page 15: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 15/64

causal- comparative studies… …the independent variable has already

occurred and cannot be manipulatedexperimental studies… …the researcher manipulates the

independent variable to determine itseffects

Page 16: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 16/64

causal- comparative studies… …the random sample is selected from two

already-existing populationsexperimental studies… …the random sample is selected from a

single population

Page 17: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 17/64

Conducting a causal-comparativestudy…

1. select the problem

2. select participants and instrument3. design and procedure4. data analysis and interpretation

Page 18: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 18/64

1. select the problem…

…the researcher starts with an effectand seeks its causes

…the independent variable cannot or

should not be manipulated

Page 19: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 19/64

2. select the participants and instrument…

…select samples representative oftheir respective populations andsimilar with respect to critical

variables other than the independentvariable…called “ comparison groups ”

Page 20: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 20/64

3. design and procedure…

…the performance of the groups iscompared using some validdependent variable measure

(“ instrument ”) …lack of randomization, manipulation,and control are sources of weakness

Page 21: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 21/64

control

…the process by which the researcherattempts to ensure that the findingsare as free of researcher bias anderror as possible

Page 22: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 22/64

types of control…random assignment of participants to

groups …pair -wise matching …comparing homogeneous groups

…comparing homogeneous subgroups …factorial analysis of variance …analysis of covariance

Page 23: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 23/64

Page 24: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 24/64

pair-wise matching

…f i r s t : find a participant in the second (third,fourth, etc.) group with the same or similarscore on the control (nonmanipulated)variable as the participant in the first group

…seco n d : if a participant in either groupdoes not have a suitable match, theparticipant is eliminated from the study

Page 25: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 25/64

comparing homogeneous groups

…control for extraneous variables thatare homogeneous with respect to theextraneous variables

…l imi ta t ion : lowers the number ofparticipants in the study and, ofcourse, limits the generalizability ofthe findings

Page 26: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 26/64

comparing homogeneous subgroups…form subgroups within each group that

represent all levels of the control(nonmanipulated) variable

…controls for the variable and also permitsthe researcher to determine whether theindependent variable affects thedependent variable differently at differentlevels of the control (nonmanipulated)

variable

Page 27: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 27/64

factorial analysis of variance (“FANOVA”)

…building the control (nonmanipulated)variable into the research design

…then use FANOVA to analyze the results

to determine the effect of the independentand control (nonmanipulated) variable onthe dependent variable, both separatelyand in combination

Page 28: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 28/64

…FANOVA allows the researcher to

determine if there is an interactionbetween the independent variableand the dependent variable such thatthe independent variable operatesdifferently at different levels of theindependent variable building it intothe research design

Page 29: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 29/64

analysis of covariance (“ANCOVA”) …statistically adjusts initial group

differences on a dependent variable forinitial differences on some other variablerelated to performance on the dependentvariable

…removes initial differences so that theresults can be fairly compared as if the twogroups started equally

Page 30: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 30/64

symbolic representation of the basiccausal-comparative design

Independent DependentGroup Variable Variable

(E) (X) O

(C) O

Where: E (experimental group); C (control group);X (independent variable); O (dependent variable)

Page 31: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 31/64

Independent DependentGroup Variable Variable

(E) (X 1) O(C) (X 2) O

Where: E (experimental group); C (control group);X (independent variable); O (dependent variable)

Page 32: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 32/64

4. Data analysis and interpretation…

…researcher uses a variety ofdescr ip t ive and inferent ia l s tat is t ics :

mean

standarddeviation

t-test

analysis ofvariancechi squared

Page 33: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 33/64

mean

…the descriptive statistic indicating theaverage performance of an individualor group on a measure of somevariable

Page 34: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 34/64

standard deviation

…the descriptive statistic indicating thespread of a set of scores around themean

Page 35: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 35/64

t-test

…the inferential statistic indicatingwhether the means of tw o groups aresignificantly different from oneanother

Page 36: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 36/64

analysis of variance (“ANOVA”)

…the inferential statistic indicating thepresence of a significant differenceamong the means of th ree or m oreg r o u p s

Page 37: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 37/64

chi squared ( Χ 2 )

…the inferential statistic indicating thatthere is a greater than expecteddifference among group frequencies

Page 38: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 38/64

Page 39: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 39/64

…causal -comparative studies typicallyinvolve two (or more) groups and oneindependent variable, whereascorrelational studies typically involvetwo (or more) variables and one group

True

Page 40: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 40/64

…causal -comparative studies involverelation, whereas correlationalstudies involve cause

False

Page 41: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 41/64

…oftentimes, causal -comparativeresearch is undertaken because theindependent variable could bemanipulated but should not

True

Page 42: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 42/64

…one of the most important reasonsfor conducting causal-comparativeresearch is to identify variablesworthy of experimental investigation

True

Page 43: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 43/64

…“lack of control” means that theresearcher can and shouldmanipulate the independent variable

False

Page 44: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 44/64

…each group in a causal -comparativestudy represents a differentpopulation

True

Page 45: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 45/64

Page 46: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 46/64

…there is random assignment totreatment groups from a singlepopulation in causal-comparativestudies

False

Page 47: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 47/64

Page 48: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 48/64

…matching, comparing homogenousgroups or subgroups, and covariateanalysis are strategies that enableresearchers to overcome problemsof initial group differences on an

extraneous variableTrue

Page 49: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 49/64

Page 50: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 50/64

…extraneous variables or confoundingfactors may be the real “cause” ofboth the independent and dependentvariables

True

Page 51: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 51/64

Fill in the blank…

…groups selected for a causal -comparative study which differ onsome independent variable and

comparing them on some dependentvariablecomparison groups

Page 52: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 52/64

Fill in the blank…

…unexplained variables that influencea dependent variable

confounding factors

extraneous variables

Page 53: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 53/64

Fill in the blank…

…a method for controlling extraneousvariables by comparing groups thatare homogeneous with respect to

the extraneous variablecomparing homogeneous groups

Page 54: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 54/64

Fill in the blank…

…a method for controlling extraneousvariables by forming subgroupswithin each group that represent alllevels of the control variable

comparing homogeneous subgroups

Page 55: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 55/64

Page 56: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 56/64

Fill in the blank…

…a statistical tool to adjust initialgroup differences on variables

analysis of covariance

Page 57: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 57/64

Fill in the blank…

…the descriptive statistic indicatingthe average performance of a groupon a measure of some variable

mean

Page 58: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 58/64

Fill in the blank…

…the descriptive statistic indicatinghow clustered or spread out aroundthe mean a set of scores is

standard deviation

Page 59: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 59/64

Fill in the blank…

…the inferential statistic determiningwhether there is a significantdifference between the means of tw o groups

t-test

Page 60: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 60/64

Page 61: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 61/64

Page 62: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 62/64

Fill in the blank…

…activities by which a researcherendeavors to ensure that the resultsof a causal-comparative study arenot tainted by extraneous variables

control

Page 63: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 63/64

This module has focused on...

…which identify the cause, orreason, for existing differences inthe behavior or status of groups

causal-comparative studies

Page 64: Causal (1)

8/13/2019 Causal (1)

http://slidepdf.com/reader/full/causal-1 64/64