Sarv-siksha Abhiyaan-Neelam Shami Rao
Transcript of Sarv-siksha Abhiyaan-Neelam Shami Rao
RESEARCH EVALUATIONRESEARCH, EVALUATION, MONITORING AND SUPERVISION
Sarva Siksha AbhiyanSarva Siksha Abhiyanbbbyby
Neelam Shami RaoNeelam Shami Rao
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
11
P t ti C t tP t ti C t tPresentation ContentsPresentation Contents
SSA GoalsSSA GoalsMonitoring Principles Under SSAMonitoring Principles Under SSAMonitoring Systems Under SSAMonitoring Systems Under SSAg yg yMonitoring InstituteMonitoring InstituteDISEDISEDISE DISE QMTQMTResearchesResearchesResults FrameworkResults Framework
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
22
SSA GOALSSSA GOALS
All children in school, Education Guarantee Centre Alternate School ‘Back-to-School’Centre, Alternate School, Back-to-School camp by 200Bridging gender and social gaps in:Bridging gender and social gaps in:• Primary : 2007• Elementary : 2010Universal retention by 2010Universal retention by 2010Focus on satisfactory quality with emphasis on education for life
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
33
on education for life
Monitoring Principles Under SSAMonitoring Principles Under SSA
SSA EnvisagesSSA EnvisagesCommunity based Monitoring systemCommunity based Monitoring systemEMIS to Incorporate Correlation ofEMIS to Incorporate Correlation ofEMIS to Incorporate Correlation of EMIS to Incorporate Correlation of school level data with community school level data with community b d i f i f i l ib d i f i f i l ibased information from microplanning based information from microplanning and surveysand surveysyyPMIS for periodic reporting systemPMIS for periodic reporting system
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
44
Contd/…(Monitoring Principles Under SSA)Contd/…(Monitoring Principles Under SSA)
Basic Principles in MonitoringBasic Principles in MonitoringCommunity OwnershipCommunity OwnershipPeriodic quality checks by externalPeriodic quality checks by externalPeriodic quality checks by external Periodic quality checks by external teamsteamsIndependent feedback on programmeIndependent feedback on programmeIndependent feedback on programme Independent feedback on programme implementationimplementationP i i f t R 1500/P i i f t R 1500/ h lh lProvision of upto Rs 1500/Provision of upto Rs 1500/-- per school per school per year for REMSper year for REMS
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
55
Monitoring Systems UnderMonitoring Systems UnderMonitoring Systems Under Monitoring Systems Under SSASSA
DistrictDistrict LevelLevel CommitteeCommittee comprisingcomprising locallocalpublicpublic representativesrepresentatives forfor monitoringmonitoringpublicpublic representativesrepresentatives forfor monitoringmonitoringProgressProgress againstagainst keykey monthlymonthly indicatorsindicators andandquarterlyquarterly progressprogress reportreport fromfrom StatesStates totoq yq y p gp g ppGovernmentGovernment ofof IndiaIndia..EducationalEducational MISMIS (DISE)(DISE) -- annualannual schoolschool--b db d d td tbasedbased datadata..EducationalEducational DevelopmentDevelopment IndexIndex (EDI)(EDI) ToToassessassess statestate progressprogress towardstowards UEEUEEassessassess statestate progressprogress towardstowards UEEUEE..SchoolSchool ReportReport CardsCards developeddeveloped atatwwwwww nuepanuepa orgorg
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
66
wwwwww..nuepanuepa..orgorg..
M it i S t U d SSAM it i S t U d SSAMonitoring Systems Under SSAMonitoring Systems Under SSA
4141 IndependentIndependent NationalNational SocialSocial ScienceScienceppInstitutionsInstitutions toto makemake independentindependent &®ularregular fieldfield visitsvisits toto monitormonitorperformanceperformanceperformanceperformance..AnAn independentindependent JointJoint ReviewReview MissionMissionreviewsreviews thethe progressprogress ofof SSASSA twicetwice aa yearyearreviewsreviews thethe progressprogress ofof SSASSA twicetwice aa yearyearPupilPupil achievementachievement levellevel samplesample surveyssurveysareare conductedconducted everyevery threethree yearsyears bybyyy yy yyNCERTNCERT toto checkcheck increaseincrease inin learninglearninglevelslevels
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
77
Contd/…(Monitoring Systems Under SSA)Contd/…(Monitoring Systems Under SSA)
Several Several independent independent assessments/studiesassessments/studies carried out forcarried out forassessments/studiesassessments/studies carried out for carried out for independent feedback on implementation of independent feedback on implementation of SSASSA
Out of School Study, 2005. Out of School Study, 2005. Student & Teacher attendance rates 2007Student & Teacher attendance rates 2007study on Parastudy on Para--Teachers 2007.Teachers 2007.
Independent Independent concurrent financial reviewsconcurrent financial reviewsi i d b th Mi i t 32 St t /i i d b th Mi i t 32 St t /commissioned by the Ministry. 32 States/ commissioned by the Ministry. 32 States/
UTs covered so far & review in respect of 3 UTs covered so far & review in respect of 3 States/UTs under progressStates/UTs under progress
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
88
States/UTs under progress.States/UTs under progress.
Contd/…(Monitoring Systems Under SSA)Contd/…(Monitoring Systems Under SSA)
A set of quality monitoring tools, developed in A set of quality monitoring tools, developed in collaboration with NCERT, to provide quarterly and collaboration with NCERT, to provide quarterly and , p q y, p q yannual information on several quality related indices of annual information on several quality related indices of SSA has been rolled out, with 29 States reports SSA has been rolled out, with 29 States reports received, covering: received, covering: --, g, g
Student enrolment and actual attendanceStudent enrolment and actual attendancePupil achievement levelsPupil achievement levelsTeacher availability and teacher trainingTeacher availability and teacher training
Classroom PracticesClassroom PracticesA d i i i f h l b Cl tA d i i i f h l b Cl tAcademic supervisions of schools by Cluster Academic supervisions of schools by Cluster and Block Resource Centres.and Block Resource Centres.Community perceptions of school functioningCommunity perceptions of school functioning
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
99
Community perceptions of school functioning.Community perceptions of school functioning.Regular reviews at secretary level and field visitsRegular reviews at secretary level and field visits
Monitoring Institutes to giveMonitoring Institutes to giveIndependent Feedback – triangulation of i f ti i d f St t th hinformation received from States through
PMIS/ DISE/QMTTo assess the progress of implementation of approved plans at District and To assess the progress of implementation of approved plans at District and State level.State level.
To sample check progress in achievement of some key out come indicators.To sample check progress in achievement of some key out come indicators.p p g yp p g yTo verify process and procedures undertaken for implementation of SSA.To verify process and procedures undertaken for implementation of SSA.
The monitoring institutions engaged for a 2 year period.5% of Elementary Schools/EGS/AIE centre will be visited
during period of two years.Si thl t i 25% f th b f di t i tSix monthly reports covering 25% of the number of districts
allotted to the Monitoring Institutes.SPDsSPDs areare requiredrequired toto shareshare thethe findingsfindings ofof MIsMIs withwith thethe DistrictDistrict levellevel officerofficer
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1010
qq gginin theirtheir MonthlyMonthly meetingsmeetings forfor remedialremedial actionaction..
4141 InstitutesInstitutes provideprovide feedbackfeedback tilltill nownow moremore thanthan 400400 districtsdistricts coveredcovered
Sample of Observations from MIsSample of Observations from MIsSample of Observations from MIsSample of Observations from MIs
TextbooksTextbooks
All categories of children in the districts received All categories of children in the districts received text books within one month of the beginning oftext books within one month of the beginning oftext books within one month of the beginning of text books within one month of the beginning of the academic year 2006the academic year 2006--07 (Gauwahati 07 (Gauwahati University)University)100100 perper centcent childrenchildren receivedreceived textbookstextbooks (IDS,(IDS,Jaipur)Jaipur)TextText booksbooks notnot beenbeen suppliedsupplied withinwithin oneone monthmonthofof thethe openingopening ofof thethe schoolsschools inin anyany sampledsampled
h lh l (A(A NN Si hSi h I tit tI tit t P t )P t )schoolsschools (A(A..NN.. SinhaSinha Institute,Institute, Patna)Patna)FullFull setssets ofof textbookstextbooks havehave notnot beenbeen receivedreceivedandand distributeddistributed toto thethe UpperUpper primaryprimary studentsstudents
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1111
andand distributeddistributed toto thethe UpperUpper primaryprimary studentsstudentseveneven upup toto SeptemberSeptember 20072007(Kurukshetra(KurukshetraUniversity,University, Haryana)Haryana)
District Information SystemDistrict Information SystemDistrict Information System District Information System of education (DISE)of education (DISE)
DISE started in 1990sDISE started in 1990sScaled up in all districts since 2004Scaled up in all districts since 2004Scaled up in all districts since 2004Scaled up in all districts since 2004Provide a time series dataProvide a time series dataBase for evidence based planningBase for evidence based planningp gp g
School based information systemSchool based information systemPhysical infrastructure and facilitiesPhysical infrastructure and facilitiesyyAvailability of teachersAvailability of teachersEnrollment and academic performanceEnrollment and academic performanceppTraining of teachersTraining of teachers
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1212
District Information SystemDistrict Information SystemDistrict Information System District Information System of education (DISE)of education (DISE)
3030thth September as a record dateSeptember as a record dateComputerised indigenous and flexibleComputerised indigenous and flexibleComputerised indigenous and flexibleComputerised indigenous and flexibleSoftware responds to field requirementSoftware responds to field requirementData Utilised for monitoring as well as planningData Utilised for monitoring as well as planningData Utilised for monitoring as well as planningData Utilised for monitoring as well as planningData TriangulationData Triangulation
5% sample check by Independent Agency for data5% sample check by Independent Agency for data5% sample check by Independent Agency for data 5% sample check by Independent Agency for data veracityveracityConsistency checks inbuilt in the systemConsistency checks inbuilt in the system
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1313
Educational Development Index (EDI)
• Educational Development Indexdeveloped based on Districtdeveloped based on DistrictInformation System of Education(DISE) in 2006-07
• Ranking on 4 parameters – Access,Infrastructure, Teachers, Outcome(GER, GPI etc)( )
• No. of States on low EDI Valuereducing
EDI EDI ValueValue
No. of StatesNo. of States
> 0.75> 0.75 0.6250.625--0.750.75
<0.62<0.6255
• Ranking of districts on similar basis
20072007--0808 33 1616 1616
20062006--0707 00 1313 2222
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
14141-9 10-1819-27 28-35
• More SSA funds for low EDI areas.
Tracking Quality OutcomesTracking Quality OutcomesNationalNational SampleSample SurveysSurveys forfor PupilPupil AchievementAchievementeveryevery 33 yearsyearsyy yyBaseBase lineline studiesstudies forfor ClassClass III,III, V,V, VIIVII andand VIIIVIIIcompletedcompletedppFundFund setset upup toto enhanceenhance NCERTNCERT capacitiescapacities forformodernizingmodernizing testingtesting methodologiesmethodologiesgg gg ggSecondSecond roundround ofof achievementachievement surveysurveyss -- ClassClass VVcompletedcompleted,, ClassClass IIIIII && VII/VIIIVII/VIII underunder wayway..yyNationalNational CurriculumCurriculum FrameworkFramework 20052005 rollingrolling outoutMeasurableMeasurable outcomesoutcomes forfor ClassClass IIIIII revisedrevisedMeasurableMeasurable outcomesoutcomes forfor ClassClass IIIIII revisedrevised
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1515
MONITORING FOR QUALITY DIMENSIONS UNDER SSA: Quality Monitoring ToolsUNDER SSA: Quality Monitoring Tools
STATE
DISTRICT
BLOCK
CLUSTER
SCHOOL/ COMMUNITY
QualityQuality outcome:outcome:Learners’ AchievementLearners’ Achievement in scholastic and coin scholastic and co--
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1616scholasticscholasticQuality of outcome, input, processesQuality of outcome, input, processes, ,
Objectives of QualityObjectives of QualityObjectives of Quality Objectives of Quality Monitoring toolsMonitoring tools
The Objective of monitoring has been to: The Objective of monitoring has been to: f f ili i d i l hf f ili i d i l hperform a facilitative and supportive role ratherperform a facilitative and supportive role rather
than supervisory role in strengthening the than supervisory role in strengthening the i i i l li i i l lexisting systems at various levelsexisting systems at various levels..
focus on processes rather than on physical focus on processes rather than on physical targetstargetsprovide feed back to States for taking corrective provide feed back to States for taking corrective
d l i i f id l i i f imeasures and evolving strategies for managing measures and evolving strategies for managing QualityQuality
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1717
i ii i ff Q li l d iQ li l d iDimensionsDimensions forfor Quality Elementary Education Quality Elementary Education (Components of Formats)(Components of Formats)
• Basic Infrastructure and other Facilities
M dC i S• Management and Community Support
• School and Classroom Environment
• CurriculumandTeachingLearningMaterial• Curriculum and Teaching Learning Material
• Teacher and Teacher Preparation
• OpportunityTime(Teaching LearningTime)
Quality Dimensions
of • Opportunity Time (Teaching-Learning Time)
• Classroom Practices and Processes
• Learners' Assessment MonitoringandSupervision
of Elementary Education
• Learners Assessment, Monitoring and Supervision
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1818
fl f f ifl f f iTwo way flow of InformationTwo way flow of Information
National level
Di t i t l l
State level
SPO + SCERT
BRC level
District level
DPO + DIET
CRC level
School Level / Community Level
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
1919
PrePre requisites for Effective Monitoringrequisites for Effective MonitoringPrePre--requisites for Effective Monitoringrequisites for Effective MonitoringStructures (BRCs, CRCs) are in place.Structures (BRCs, CRCs) are in place.Personnel are in position at all places (Teachers, Personnel are in position at all places (Teachers, CRCCs,BRCCs, DEO, DIET faculty, etc.)CRCCs,BRCCs, DEO, DIET faculty, etc.)J b fil d li t d lJ b fil d li t d lJob profiles are delineated properly.Job profiles are delineated properly.Capacities are builtCapacities are built--up among personnel at different levels.up among personnel at different levels.Systems are gearedSystems are geared up to enable the personnel toup to enable the personnel toSystems are gearedSystems are geared--up to enable the personnel to up to enable the personnel to discharge their responsibilities.discharge their responsibilities.Need identification exercise in respect of capacity building ofNeed identification exercise in respect of capacity building ofNeed identification exercise in respect of capacity building of Need identification exercise in respect of capacity building of
personnel is undertaken regularly. personnel is undertaken regularly. Organizational climate is conducive.Organizational climate is conducive.Data are gathered timely on Quality Monitoring Formats and Data are gathered timely on Quality Monitoring Formats and analyzed/ shared at each level.analyzed/ shared at each level.
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2020
Results Framework
Against all four Goals• Outcome IndicatorOutcome Indicator
• Baseline
• Target Value for the next three year
• Frequency & Reportq y p
• Data Collection Instruments
f C• Responsibility for Data Collection
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2121
Researche: TriangulatingResearche: TriangulatingResearche: Triangulating Researche: Triangulating InformationInformation
Rs 1,500/Rs 1,500/-- per school per school –– Rs 200 at the National levelRs 200 at the National levelCommittee for approval of research projects (CARP)Committee for approval of research projects (CARP)Committee for approval of research projects (CARP) Committee for approval of research projects (CARP) under chairmanship of Secreatry SE&L at National under chairmanship of Secreatry SE&L at National level to decide on research agendalevel to decide on research agendaCARP State levelCARP State levelCARP State levelCARP State levelImportant information for triangulationImportant information for triangulation–– Out of school children sample study 2005Out of school children sample study 2005p yp y–– Study on Student and teacher attendanceStudy on Student and teacher attendance–– Study on para teachers etcStudy on para teachers etc
Many studies in pipelineMany studies in pipelineMany studies in pipelineMany studies in pipelineResearch including action researches at the district Research including action researches at the district and subdistrict leveland subdistrict level
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2222
Tracking Quality: Triangulating Information• Tracking teacher and student attendance• Tracking teacher and student attendance• States commitment to revamp teacher accountability mechanisms
Students Attendance 68.5% Teacher Attendance 81.7%
Primary
< 70%70 – 80%
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
232380 – 90%> 90%
Goal I : All children in school / EGS centres / Alternative and Innovative Education centresAlternative and Innovative Education centres
Outcome IndicatorOutcome Indicator: Number of children aged 6-14 years not enrolled in School / EGS Centres / AIE Centres
Baseline: 13 4 million children were out of schoolBaseline: 13.4 million children were out of school (Independent Study 2005)
Target: Reduce OoSC to Zero
Frequency & Report: Annual PMIS ReportIndependent Sample Survey on OoSC in 2008 09
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2424
Independent Sample Survey on OoSC in 2008-09
Outcome Indicator: Process indicators on quality -
Goal 4 :Contd/….
Baseline:
Outcome Indicator: Process indicators on quality Attendance Rates of Students and Teachers
Student Attendance level is 70% at primary and 75% at upper primary Teacher Attendance level is 81% at primary and 80% at upper primary (2006 : Independent Study 17 States)
Target Value:Increase student and teacher attendance to more than 90% at all levels
Frequency & Report: Annual PMIS/ QMT Reports disaggregated by States
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2525
p gg g yIndependent Sample Study on student and teacher attendance to be repeated in 2009-10
Outcome Indicator: National student achievement level Goal 4 :Contd/….
outcomes Baseline:Learning levels for Class III -58 % in Maths & 63 % LanguageLearning levels for Class V 46% in Maths, 58 % in Language,
0% i EVS50% in EVS Learning levels for Class VII/VIII - 30% / 38% in Maths, 52% / 52% in Language 36% / 40 in Science and 33% / 40% in52% in Language, 36% / 40 in Science and 33% / 40% in Social Science( NCERT National Assessment Sample Survey -1st round)( NCERT National Assessment Sample Survey 1 round) Target: Improve Learning levels in each round.Frequency & Report:Frequency & Report:
2nd round outcomes for Class III and Class VII in 2008 - 09 3rd round for Class V in 2009-10
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2626
3 round for Class V in 2009 103rd round for Class III and VII/. VIII in 2010 - 2011
Tracking Quality Outcomes Cntd/...Tracking Quality Outcomes Cntd/...
State Rankings for overall MAS Class V
• Improvement in learningachievement in all the subjects in
State Rankings for overall MAS Class V
RanksRanks StatesStates
ClassesClasses MathsMaths LangLang EVSEVS
achievement in all the subjects inclass V.1 to 51 to 5 West Bengal, Karnataka, West Bengal, Karnataka,
Gujarat, Jharkhand, TripuraGujarat, Jharkhand, TripuraClassesClasses MathsMaths Lang. Lang. EVSEVS
Class VClass V((11stst
roundround))
46.5146.51 58.5758.57 50.3050.306 to 106 to 10 Uttar Pradesh, Maharastra, Uttar Pradesh, Maharastra,
Tamil Nadu, Delhi, Madhya Tamil Nadu, Delhi, Madhya PradeshPradesh
11 1511 15 O i Hi h l P d hO i Hi h l P d h roundround))Class VClass V
((22ndnd
roundround))
48.4648.46 60.3160.31 52.1952.1911 to 1511 to 15 Orissa, Himachal Pradesh, Orissa, Himachal Pradesh,
Mizoram, Manipur, RajasthanMizoram, Manipur, Rajasthan
16 to 2016 to 20 Kerala, Punjab, Arunachal Kerala, Punjab, Arunachal roundround))
• Goa, HP, Gujarat, J& K, UP, Karnataka Kerala improved by
Pradesh, Nagaland, HaryanaPradesh, Nagaland, Haryana
21 to 2521 to 25 Andhra Pradesh, D & N H, Andhra Pradesh, D & N H, Daman & Diu, Chandigarh, Daman & Diu, Chandigarh, Karnataka, Kerala, improved by
more than 5 percent pointsJammu & Kashmir Jammu & Kashmir
26 to 3026 to 30 Meghalaya, Assam, Meghalaya, Assam, Uttarakhand, Sikkim, GoaUttarakhand, Sikkim, Goa
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
272731 to 3331 to 33 Chhattisgarh, Puducherry, A Chhattisgarh, Puducherry, A
& N Island, & N Island,
Department of school Education and Literacy, Department of school Education and Literacy, MHRD, Govt. of IndiaMHRD, Govt. of India
2828