THE STRATEGY TO DEVELOP CHILE’S PERMANENT EDUCATION SYSTEM

April 2009, Washington D.C.

1. CHILE’S POLITICAL AND ECONOMIC CONTEXT

2. PROVISIONAL IMPACT EVALUATION, LABOR COMPETENCES AND LEVELING

3. INSTITUTIONAL ARRANGEMENTS AND STRATEGY TO BUILD THE VIABILITY OF THE PERMANENT EDUCATION SYSTEM

4. CURRENT CHALLENGES

•CHILE IS A MIDDLE ECONOMIC DEVELOPMENT COUNTRY IN THE INTERNATIONAL CONTEXT

•CHILE IS AN OPEN ECONOMY EXPOSED TO A HIGH LEVEL OF CHANGE

•THE EDUCATION SYSTEM OPERATES BASED ON THE REGULATORY AND FINANCIAL ROLE OF THE STATE AND THE PRIVATE OR MUNICIPAL PRODUCTION OF EDUCATION SERVICES

•THE STATE IS ORGANIZED INTO SECTORS AND THE EDUCATIONAL FUNCTIONS ARE DISTRIBUTED ACROSS VARIOUS GOVERNMENT DEPARTMENTS

POLITICAL AND ECONOMIC CONTEXT

THE STATE’S CHALLENGE IN A DEMOCRATIC MODERNIZATION

•NEW FORMS OF INTERACTION WITH A CHANGING CITIZENSHIP

•NEW PROBLEMS PRESENT IN THE CONTEXT OF GLOBALIZATION

•THE STATE’S INADEQUACY TO DEAL WITH SUPRA-SECTORIAL PROBLEMS

•DEFICIT OF BASIC COMPETENCES IN THE LABOR FORCE, EXPRESSED AS LOW SCHOOLING.

•POOR QUALITY AND PERTINENCE OF TECHNICAL TRAINING, IN SECONDARY AND HIGHER EDUCATION.

•LOW QUALITY, PERTINENCE AND TARGETING OF TRAINING.

•NIL ARTICULATION ACROSS FORMAL, NON FORMAL AND INFORMAL EDUCATION MODALITIES.

•LACK OF AN INTEGRATED INFORMATION SYSTEM, FOR USE BY EDUCATION DEMAND AND SUPPLY AGENTS.

HUMAN CAPITAL PROBLEM IN CHILE

LEGAL PROGRESS TO LAY THE BASIS OF THE PERMANENT EDUCATION SYSTEM (SFP) AND

PROVISIONAL EVALUATION OF IMPACT – TECHNICAL EFFECTIVENESS IN COMPETENCES

AND LEVELING PROGRAMMATIC LINES

1. LABOR COMPETENCES NATIONAL CERTIFICATION SYSTEM LAW

2. DRAFT GENERAL EDUCATION LAW

3. NEW ADULT CURRICULAR FRAMEWORK

4. NATIONAL TRAINING AND EMPLOYMENT NATIONAL SERVICE LAW

LEGAL PROGRESS AS AT 2009

•QUASI-EXPERIMENTAL WITH EX-POST AND CONTROL GROUP MEASUREMENTS

•SURVEY SEEKING TO MEASURE POST-PROGRAM SITUATION (2008) AND RECONSTRUCT PRE-PROGRAM SITUATION (2005) BY MEANS OF RETROSPECTIVE QUESTIONS

•BENEFICIARIES: SAMPLE OF TRAINED PEOPLE, IN ADDITION TO TRAINED AND CERTIFIED YEAR 2006

•CONTROLS: SAMPLE OF INDIVIDUALS WITH SIMILAR CHARACTERISTICS DRAWN FROM THE CASEN 2006 SURVEY (HOUSEHOLDS)

•IMPACT ESTIMATOR: AVERAGE EFFECT OF THE PROGRAM ON THE PARTICIPANTS (EPPP)

•AND BROKEN DOWN BY SEX, < 40 YEARS OR > 40 YEARS, METROPOLITAN REGION / OTHER REGIONS, WITH CERTIFICATION OF COMPETENCES/ WITHOUT CERTIFICATION OF COMPETENCES

DESIGN OF IMPACT EVALUATION OF COMPETENCE-BASED TRAINING

•GIVEN THE DISTRIBUTION, THE CHOICE BASED SAMPLING IS CORRECTED BY MEANS OF WEIGHTING FACTORS

•PAIRING BASED ON PROPENSITY SCORES MATCHING•A DIFFERENT PARTICIPATION MODEL WAS USED TO ESTIMATE THE IMPACTS IN EACH SUB-SAMPLE

•PAIRING METHOD: GAUSSIAN KERNEL. ESTIMATING THE COUNTERFACTUAL OUTCOME FOR EACH PARTICIPANT USING THE WEIGHTED AVERAGE OF THE OUTCOMES FOR ALL THE CONTROLS, WHERE THE WEIGHTING IS INVERSELY PROPORTIONAL TO THE PARTICIPATION PROPENSITY DISTANCE

•FOR THE ESTIMATION ONLY THE CASES IN THE CORRESPONDING COMMON SUPPORT WERE USED

DESIGN OF IMPACT EVALUATION OF COMPETENCE-BASED TRAINING

CONTROL BENEFICIARY CONTROL BENEFICIARYN 472 464 936 9,147 9,911 19,058% 0.5 0.5 0.48 0.52

TOTAL

SAMPLE

TOTAL

POPULATION

  N MeanMean

Difference t Sig.Beneficiary

375 CH$21,399$12,114 2.353 **

Control 366 CH$9,285

EVALUATION OF PROVISIONAL IMPACT IN COMPETENCES - MONTHLY LABOR INCOME

“…Participants experienced an increased in their monthly labor income (liquid) > 100%.”

“The group with certification not only experienced the highest increase in their labor income, but also their counterfactual condition is worse that in the case of those who did not certify competences.”

  Beneficiaries

Controls Average Change Beneficiaries

Average Change Controls

Impact t

With competence certification

207 357 CH$23,914 CH$6,703 $17,210 2.173

Wo. competence certification

176 378 CH$16,354 CH$12,012 $4,342 0.651

COMPETENCES – MONTLY LIQUID INCOME AND CERTIFICATION

  Beneficiaries Controls Average Change

Beneficiaries

Average Change Controls

Impact t

With competence certification

207 357 CH$726 CH$275 451 1.733

Wo. competence certification

176 378 CH$46 CH$403 -357 -1.053

“…a competence-based training process, linked to the certification process, seems to be an effective mechanism to extend the high productivity horizon of workers, delaying the point of decline in the lifecycle of labor income.”

COMPETENCES – PRODUCTIVITY, CHANGE IN HOURLY-WEEKLY WAGES IN MAIN JOB

  Beneficiaries

Controls Average Change

Beneficiaries

Average Change Controls

Impact t

With competence certification

207 357 -0.043 -0.078 0.035 1.358

Wo. competence certification

176 378 -0.063 -0.069 0.006 0.210

“… a less pronounced worsening than that estimated in the condition without the Program .”

COMPETENCES – LABOR INCLUSION, CHANGE IN THE PROBABILITY OF BEING EMPLOYED

EVALUATION DESIGN – IMPACT OF EDUCATION LEVELING

•TREATED AND CONTROLS WERE ADMINISTERED A SURVEY SEEKING TO MEASURE THEIR POST-PROGRAM SITUATION (2008) AND TO RECONSTRUCT THEIR PRE-PROGRAM CONDITION (2004) BY MEANS OF RETROSPECTIVE QUESTIONS.

•BENEFICIARIES: SAMPLE OF GRADUATES OF THE SECONDARY CYCLE FOR THE YEAR 2005

•CONTROLS: SAMPLE OF INDIVIDUALS WITH SIMILAR CHARACTERISTICS NOT HAVING COMPLETED SECONDARY EDUCATION, DRAWN FROM THE CASEN 2006 SURVEY (HOUSEHOLDS)

•IMPACT ESTIMATOR: EPPP FOR THE TOTAL BENEFICIARIES

•BROKEN DOWN BY SEX, < 35 YEARS OR > 35 YEARS, METROPOLITAN REGION / OTHER REGIONS

EVALUATION DESIGN- IMPACT OF EDUCATIONLEVELING

•GIVEN THE PREVIOUS DISTRIBUTION, THE CHOICE BASED SAMPLING IS CORRECTED WITH WEIGHTING FACTORS

• PAIRING THROUGH PROPENSITY SCORES MATCHING. A DIFFERENT PARTICIPATION

MODEL WAS USED TO ESTIMATE IMPACTS IN EACH SUBSAMPLE

•PAIRING METHOD: GAUSSIAN KERNEL. ESTIMATES THE COUNTERFACTUAL RESULT FOR EACH PARTICIPANT USING THE WEIGHTED AVERAGE OF THE RESULTS OF ALL CONTROLS, WHERE THE WEIGHTING IS INVERSELY PROPORTIONAL TO THE DISTANCE IN PARTICIPATION PROPENSITY

•ONLY THE CASES IN THE CORRESPONDING COMMON SUPPORT WERE USED FOR THE ESTIMATE

CONTROL BENEFICIARY CONTROL BENEFICIARYN 333 404 737 1,850,829 100,829 1,951,658% 45% 55% 95% 5%

TOTAL

SAMPLE

TOTAL

POTENTIAL POPULATION

  Beneficiaries

Controls Average Change Beneficiaries

Average Change Controls

Impact t

All 401 317 CH$18,379 CH$1,283 CH$17,096

2.097

EDUCATION LEVELING – CHANGE IN MONTHLY LIQUIDINCOME FROM MAIN JOB

“…beneficiaries increased their labor income by over10%, while their paired controls practically showed no increase.”

  Beneficiaries

Controls Average Change

Beneficiaries

Average Change Controls

Impact t

All 401 317 CH$232 CH$17 CH$216

1.013

LEVELING – PRODUCTIVITY, CHANGE IN HOURLY-WEEKLY WAGES IN THE MAIN JOB

“There is no evidence of impact, although there is a considerable difference of magnitude between the average changes of beneficiaries and controls.”

  Beneficiaries

Controls Average Change

Beneficiaries

Average Change Controls

Impact t

All 401 317 0.05 0.07 -0.015 -0.413

LEVELING – IMPACT IN LABOR MARKET INCLUSION, CHANGE IN THE PROBABILITY OF BEING EMPLOYED

“Based on the analysis, it is not possible to attribute to the Program a general impact on the probability of being employed.”

  Beneficiaries

Controls Average Change

Beneficiaries

Average Change Controls

Impact t

All 401 317 0.07 0.03 0.03 2.063

LEVELING – IMPACT ON EDUCATION TRANSITION,PROBABILITY OF ACCESING POST-SECONDARYEDUCATION

“In effect, the high rate of adults with incomplete schooling detected in the diagnosis, is seen as a limitation to access the services that the SFP can offer to the population. A positive incidence of the leveling line is an important indicator of success of the demand strengthening strategy, in the context of setting the foundations for the installation of the SFP.”

DESCRIPTION INDICATOR TARGETCUMULATIVE

2008%

CUMULATIVE

INCREASING THE # OF WORKERS WITH COMPETENCE CERTIFICATION

# OF WORKERS WHO HAVE CERTIFIED THEIR COMPETENCES

12,909 PEOPLE

21,172 164.01%

INCREASING THE # OF LEVELED IN PRIMARY ADULT EDUCATION

# OF LEVELED 71,500 39,955 55.88%

INCREASING THE # OF LEVELED IN ADULT SECONDARY EDUCATION

# OF LEVELED 48,500 49,895 102.87%

INCREASING THE # OF INTERMEDIARY AGENCIESSTRENGTHENED

# OF INTERMEDIARY AGENCIES INCORPORATED TO THE STRENGTHENING PROCESS

118 AGENCIES

187 158.4%

PROGRESS STATUS OF SOME INDICATORS AGREED WITHTHE WORLD BANK IN CONNECTION WITH THE PAD

INSTITUTIONAL CONDITIONS IN CHILE AND STRATEGY USED TO BUILD THE VIABILITY OF THE PERMANENT EDUCATION SYSTEM

STRATEGIC PATHWAY OF THE PERMANENT EDUCATION SYSTEM

NEGOTIATION AND EXECUTION OF LOAN AGREEMENT

EXECUTIVE DIRECTOR TAKES OFFICE

DESIGN TRIAL PERIOD

ORGANIZATION EVALUATION

STRATEGIC PLANNING

GENERATE PUBLIC AWARENESS

LABOR COMPETENCES NATIONAL CERTIFICATION SYSTEM LAW

DRAFT GENERAL EDUCATION LAW

ARTICULATION WITH STAKEHOLDERS – PRIVATE BUSINESS, EDUCATION INSTITUTIONS, PUBLIC SERVICES

QUALIFICATIONS FRAMEWORK PROGRESS

SFP INSTITUTIONALIZATION

ESTABLISHMENT AND OPERATION OF THE LABOR COMPETENCES NATIONAL CERTIFICATION SYSTEM

LOAN AGREEMENT EXPANSION

20092005 200820022001

ASPECTS OF THE STRATEGY TO BUILD VIALIBILITY – PUBLIC POLICIES … ARE A MATTER OF POLITICS

•DEVELOPMENT OF PROPOSALS CONSISTENT WITH THE COUNTRY’S CHARACTERISTICS

•LEVERAGING INFORMATION TO ACHIEVE RECOGNITION

•PERSUADING ACTORS TO CREATE PUBLIC AWARENESS OF ISSUE

•MONITORING AND LEVERAGING OPPORTUNITIES (INTERNAL & EXTERNAL) TO ADVANCE THE AGENDA

•DEVELOPMENT OF STRATEGIC ALIGNMENT AND ONGOING AND SYSTEMIC REASSESSMENT

REDEFINING THE ROLES OF THE EXISTING TRADITIONAL INSTITUTIONS IN THE FRAMEWORK OF THE SFP

GENERATING NEW INSTITUTIONS, TO COVER ASPECTS IN WHICH THE INTEGRATION REQUIRES SUPRA-INSTITUTIONAL DECISIONS – AND MUST REMAIN CURRENT

SFP INSTITUTIONALIZATION STRATEGY

PROJECT GOVERNANCE

GOVERNANCE GOVERNANCE CAPACITY

GOVERNANCE TRIANGLE

FROM COORDINATION TO INTEGRATION IN COMPLEX PUBLIC PROBLEMS

THE STATE IS ORGANIZED INTO SECTORS

PEOPLE FACE PROBLEMS

NEED TO DEVELOP STRATEGY TO PROVIDE STABILITY IN THE FACE OF CHANGING SECTOR AUTHORITIES

WHY WAS CHILECALIFICA CREATED

THE AIM WAS

A STRATEGIC INSTANCE OF ARTICULATION ACROSS THREE GOVERNMENT DEPARTMENTSTHAT BY USING DEMONSTRATION AND PROGRAMATIC EXPERIENCES, WOULD INTEGRATE PUBLIC POLICIES IN THE AREAS OF EDUCATION, LABOR AND ECONOMY

OBJECTIVE OF THE STRATEGY USEDSOLVING THE LACK OF PERTINENT DEVELOPMENT OF THE

PERMANENT EDUCATION SYSTEM BY LEVERAGING THE WORK OF THE CHC PROGRAM AND INTERNATIONAL EXPERIENCES TO

GENERATE A PERMANENT SOLUTION

DECISION-MAKING MODEL OF THE PERMANENT EDUCATION SYSTEM

PRODUCTIVE SYSTEMS AND LABOR DEMAND INFORMATION SYSTEMS

EDUCATION DEMAND INFORMATION SYSTEM

NATIONAL SYSTEM OF CERTIFICATION OF LABOR COMPETENCES

IDENTIFICATION,VALIDATION,ADMINISTRATION

CERTIFICATION

NATIONAL QUALIFICATIONS FRAMEWORK

NATIONAL TRAINING SYSTEM

EDA CRAFTS

EMTP

HIGHER EDUCATIONCFTIPUNIVERSITIES

EDUCATION SUPPLY INFORMATION SYSTEM

GENERAL ADULT EDUCATION

CURRICULAR DESIGN AND SUPPLY DEVELOPMENT

SUPPLY QUALITY ASSURANCE

INSTITUTIONS AND STAKEHOLDERS CONNECTED WITH THE SFP DECISION-MAKING MODEL

CURRENT CHALLENGES

•CONSOLIDATION OF INSTITUTIONALITY WITHIN THE DEPARTMENT OF EDUCATION FOR PERMANENT EDUCATION POLICIES.

•DEVELOPMENT OF A DISTRIBUTED INFORMATION SYSTEM FOR SFP STAKEHOLDERS.

•DEVELOPMENT OF SFP INTEGRATION INSTITUTIONALITY.

•INSTITUTIONALIZATION OF THE QUALIFICATIONS FRAMEWORK.

•REGULAR OPERATION OF SNCCL.

•CONSOLIDATING TRANSFORMATIONS IN THE TRAINING SYSTEM.

•DEVELOPMENT OF TERRITORIAL DIMENSION OF SFP.

Thank You!