6 - Intro to Design

download 6 - Intro to Design

of 10

Transcript of 6 - Intro to Design

  • 8/20/2019 6 - Intro to Design

    1/22

    6Introduction to Design

  • 8/20/2019 6 - Intro to Design

    2/22

    • Research design is the glue that holdspieces of the research project together – The sample – The measures – The treatments or programs – The method of assignment

    Foundations of Design

  • 8/20/2019 6 - Intro to Design

    3/22

    • Causal – Pertaining to a cause-effect question,

    hypothesis, or relationship

    – omething is causal if it leads to an outcomeor ma!es an outcome happen

    – "#ot casual)

    Research Design and Causality

  • 8/20/2019 6 - Intro to Design

    4/22

  • 8/20/2019 6 - Intro to Design

    5/22

    • Temporal precedence• trength of association• Dose-response relationship• Consistently generali a%le else'here• Plausi%ility

    • Consideration of competing hypotheses• )uta%le %y e+perimentation• Coherence 'ith e+isting frame'or!s

    .ill/s Criteria for Causality

  • 8/20/2019 6 - Intro to Design

    6/22

    0nternal alidity

  • 8/20/2019 6 - Intro to Design

    7/22

    • The three main types of threats – ingle-group threats – )ulti-group threats – ocial-interaction threats

    0nternal alidity

  • 8/20/2019 6 - Intro to Design

    8/22

    • 1ccurs in single group post-test orpretest-post-test designs

    • Types* – .istory – )aturation – Testing – 0nstrumentation – )ortality "$ttrition2 – Regression to the mean

    0nternal alidity – ingle 3roup Threats

  • 8/20/2019 6 - Intro to Design

    9/22

    • Deal 'ith single-group threats %y adding asecond group( – Called a control group in an e+periment,

    comparison group in quasi-e+periment• 1nce you/&e added a control group, you

    need to address the multi-group threats to

    internal &alidity

    0nternal alidity – ingle 3roup Threats"cont/d42

  • 8/20/2019 6 - Intro to Design

    10/22

  • 8/20/2019 6 - Intro to Design

    11/22

    • election-history threat• election-maturation threat• election-testing threat• election-instrumentation threat• election-mortality threat

    • election-regression threat

    0nternal alidity – Types of election 5ias

  • 8/20/2019 6 - Intro to Design

    12/22

    • Randomization to treatment groups isthe defining characteristic of anexperiment

    0nternal alidity – )ulti-3roup Threats

  • 8/20/2019 6 - Intro to Design

    13/22

    Types of Designs

  • 8/20/2019 6 - Intro to Design

    14/22

    Random $ssignment &s4 Randomelection

  • 8/20/2019 6 - Intro to Design

    15/22

    • Diffusion or imitation of treatment• Compensatory ri&alry• Resentful demorali ation• Compensatory equali ation of treatment

    0nternal alidity – ocial-0nteractionThreats

  • 8/20/2019 6 - Intro to Design

    16/22

    • Four elements to any research design* – Time – Treatments or programs "0 6predictors2 – )easures or o%ser&ations "D 6outcomes2 – 3roups or indi&iduals

    De&eloping a Research Design

  • 8/20/2019 6 - Intro to Design

    17/22

    Design #otation

  • 8/20/2019 6 - Intro to Design

    18/22

    #otational 7+amples

  • 8/20/2019 6 - Intro to Design

    19/22

  • 8/20/2019 6 - Intro to Design

    20/22

    Different designs ha&e different'ea!nesses

    • Post-test only, t'o-group,randomi ed e+periment

    • 'itched-replication,t'o group e+periment

  • 8/20/2019 6 - Intro to Design

    21/22

    )ore designs

    • Pre-and-post-test, t'o-group,non-equi&alent groups quasi-e+periment

    • Time-series e+periment

  • 8/20/2019 6 - Intro to Design

    22/22

    • 8hy is internal &alidity so important inresearch design9

    • 8hat is the purpose of randomi ation inresearch design9

    Discuss and De%ate