1

International Perspectives on Place-Randomized Trials in

Education

Discussion of:

•Dana Burde, “Panacea or Straight Jacket?”

• Hiro Yoshikawa et al. “The Experimental Evaluation of Un Buen Comienzo”.

2

Outline

I. Place-Randomized Trials as a Global Phenomenon.

II. Burde and Linden, Afghanistan.III. Yoshikawa et al., Chile.IV. The Role of University Research

Institutes in International Collaborations on P-RTs.

3

I. Place-Randomized Trials as a Global Phenomenon.

“Can P-RTs be used to inform evidence-based Policy?”

• International: World Bank, OECD, etc.Rockefeller FoundationCampbell Collaborative.

• National: IES.

4

C2 - SPECTR

The Campbell Collaborative’s Social, Psychological, Educational, and Criminological Trials Register.

In 2005, included more than 200 references on PRTs. (Coded as “CRT”).

5

Burde/Afghanistan.“Debates Regarding Randomized

Trials”.

Weaknesses in research design Weaknesses in execution of

study Ethical issues Culture: privileging quantitative

over qualitative

6

1. Design Problems

narrow focus reductionist logic causal links too short

and simple

7

1. Design Solutions

measurement modeling modesty

8

2. Execution Problems

inadequate intervention insufficient attention to

variation within the sample inadequate separation of

treatment and control groups

9

2. Execution Solutions

implementation fidelity measure and model

treatment variability cooperation, monitoring.

10

3. Ethical Problems

withholding services perceptions of unfairness cultural bias, political

control

11

3. Ethical Solutions: Make PRTs

Scientifically Sound Community Informed Democratically/Legitimately

Governed

12

4. The Culture of Privileging Quantitative Methods

assumed infallibility hegemony

13

4. Solutions

Smart, strategic use of both approaches within PRTs and across portfolio of studies.

14

Notable Issues in Studies of CRS-funded Community Schools in

Afghanistan

Negotiations (with NGOs, State, Communities)

Pace: Pilot Trial Implementation at

Scale Revisions: Based on new information

and changes in conditions.

15

Yoshikawa et al/Chile

Rationale Stages: Pilot, Process,

Impact

16

The context of ECCE Deliberations in Chile

Need Expansion Quality

17

UBC Theory of Change: Identifying the links between

active ingredients of intervention

mediating mechanisms child outcomes

18

Interestingly, Yoshikawa discusses at the end:

Design Ethics (Communication) Execution (“Thorny Issues”)

But not “Culture of Privileging Quantitative Research”

19

IV. The Role of Universities: Intellectual

Theory Development and Interdisciplinarity

Measurement Development Statistical Modeling Bridging Cultural Distance

20

The Role of Universities: Logistical

Action in a Multi-Actor World. Raising Funds that Enable

Independent Evaluation. Transcending Geographic

Distance.

21

The Role of Universities: Policy/Political

Knowledge Development. Evidence-based Policy. Evidence-based Advocacy.

expansion reinvestment contraction