Evaluations in olpc
-
Upload
bastien-guerry -
Category
Education
-
view
1.063 -
download
0
description
Transcript of Evaluations in olpc
![Page 1: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/1.jpg)
Evaluations in OLPCWhat for ? What has been done?
What could be done ?
Pierre Varly, Independent ConsultantOctober 22, 2010
Varlyproject.wordpress.com
![Page 2: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/2.jpg)
Evaluations in OLPCWhat for ?
“An assessment for learning and not an assessment of learning”
Evaluation inputs : What works ? What’s don’t ? Why ?
Knowledge sharing in successful XO implementations
Capacity building of OLPC volunteers on education measurement and education intervention design
Better advocacy for OLPC based on common scientific standards measurement
![Page 3: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/3.jpg)
Evaluations of 1:1 projects outstide the OLPC world
Only 22 researches produce estimates of ICT effects on pupils tests score
Little information is given on the pedagogical supports embedded on the computers
Evaluations mainly in US and Canada
Science or educational belief ??
![Page 4: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/4.jpg)
1:1 reported outcomes
BETHEL E.C. & al (2009)
![Page 5: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/5.jpg)
OLPC deployment contexts IT perspective
In the USA, the average access to home computer is 76% for 3-17 years old in 2003
Haïti RwandaCambodiaEthiopia Ghana Colombia Peru Mongolia Mexico Uruguay0
2
4
6
8
10
12
14
16
0.2 0.2 0.3 0.40.60000000
0000001
4.4
10.3
13.3 13.6 13.6Ratio of computers per 100 inhabitants in ma-
jor OLPC deployment countries (2005)
![Page 6: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/6.jpg)
OLPC deployment contexts educationnal perspective
•High repetition and drop-out rates•Poor literacy environment •Inefficient teaching methods•Bad classrooms equipment•Very little effective learning time•Low social demand from parents•Language of instruction not spoken home•Very low learning outcomes•High gender, rural/urban and ethnic disparities
![Page 7: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/7.jpg)
The reading problem in OLPC deployment contexts
Adapted from GOVE A. & CVELICH P. (2010), Early Reading: Igniting Education for All. RTI International
Afghanistan
Gambia Honduras (rural
schools)
Ethiopia Haiti Uganda (Central province)
Nepal Mali Uganda (Lango
province)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
21%27% 29%
36%48% 53%
79% 83% 88%
Proportion of non readers in the early grades
![Page 8: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/8.jpg)
OLPC deployment actual evaluations
Only one paper published in a scientific review dealing with an OLPC deployment (Hourcade 2009)
As bad or as good as others 1:1 evaluations methods No measurement of effects size
Little information is given on tests used to measure learning outcomes (except for Sri Lanka, Haiti)
Too much emphasis on the attitudes and motivations of pupils in the reporting Impact evaluation reports expected 2010/2011
![Page 9: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/9.jpg)
OLPC reported outcomes (7 countries)
7 countries, see (Varly 2010) for list of countries and data limitations
Motivation Attitudes Attendance Achievement0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0% 85.7% 85.7%
28.6%
50.0%
![Page 10: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/10.jpg)
What is beeing evaluated ?
« That’s the answer, but what was the question ? »
What’s being evaluated ?
•XO ?
•SUGAR .
•SOCIO-CONSTRUCTIVISM THEORIES ?
![Page 11: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/11.jpg)
Developing OLPC evaluations toolsSimple
Cheap
Adapted to OLPC deployments ‘context
Following scientific standards
Manageable by OLPC volunteers
Share experiences in the deployment and problems/solutions in integrating XO in the school and social environment
See (Varly 2010) for a proposal of tools
![Page 12: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/12.jpg)
Case study of Nosy Komba : problems check list
Problem listCommon TICE
project problems
Developing world common problems
OLPC deployment common problems
Specific Nosy Komba
deployment problems
Lost XOs X
Installing school server X
Education authorities forbid XO use in
regular hoursXO ? XO
Teachers are not motivated X
Customs X
Invalid date system XO
Teachers don’t know what to do with XO X
Sugar activities do not match curricula XO
![Page 13: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/13.jpg)
Formative evaluation well underway
Solomon Island framework and others
OLPC France blog
OLPC blogs and wiki reporting problems and solutions with regards to implementation and not just IT issues
Could be more systematic
Could be more standardised to browse info easily
Should be more centered on specific OLPC problems
![Page 14: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/14.jpg)
Impact evaluation : take it or leave it ?
Impact evaluation so far initiated by international agencies and developement banks
Very costly
Long time for reporting but…
Good accessible methodology documentation
OLPC community should catch these powerfull tools further
![Page 15: Evaluations in olpc](https://reader036.fdocuments.us/reader036/viewer/2022081907/5480f637b37959c22b8b4631/html5/thumbnails/15.jpg)
Thanks for reading
Detailed paper and references on a Blog on Education in the developing countries
ACCESS PAPER HERE