Presentation of the Umalusi 2013/14 Annual Report to the Select Committee on Education and...

Presentation of the Umalusi 2013/14 Annual Report

to the Select Committee on Education and Recreation

______________________

05 November 2014

Dr Mafu S Rakometsi

1

Purpose / Mandate Summarised External Environment : Impact on

Umalusi Organisational Performance per Unit Financial Information Current Issues and Way Forward Conclusion

Overview

2

Umalusi’s mandate is determined by two Acts namely:

The National Qualifications Framework Act of 2008; and

The General and Further Education and Training Quality Assurance Act of 2001 amended in 2008.

Mandate Summarised

3

Qualifications and Standards: Develop and manage a sub-framework

of qualifications in collaboration with SAQA and the other two QCs supported by the necessary quality assurance policies and processes.

Mandate Summarised

4

Quality Assurance: Develop and implement the necessary quality

assurance policies i.r.o.:

- Quality assurance of provision: Accredit

private providers of education and training

and assessment and monitor the public system;

- Quality assure assessments at exit points and

certify learner achievements

Mandate Summarised

5

Information:Maintain a database of learner

achievements and related matters; and submit such data in a format determined in consultation with the SAQA for recording on the national learners’ records database

Research:Commission and publish research related to

the development and implementation of the sub-framework of qualifications

Mandate Summarised

6

Advice and Collaboration: Formalization of relationships which include:

Advice to the relevant Minister on matters relating to the GFET sub-framework of qualifications

Collaboration with the SAQA and other QCs in terms of the NQF

Advocacy of the sub-framework and its qualifications

Mandate Summarised

7

The NQF Act (2008): changes in the roles and responsibilities of the various bodies in the quality assurance landscape;

The subsequent amendment of the various Acts that govern the work of the QCs which has required more capacity and a review of Umalusi’s positions and approaches;

Differing models and views on the nature of standard setting and quality assurance

External Environment : Impact

8

The National Development Plan (2011): Highlights education and training priorities that must be addressed in planning

The process of collaboration with SAQA (and with the other QCs) in the transition to the NQF Act has meant that staff have been extensively involved in both Ministerial and SAQA task teams

Finalisation of the NQF (December 2012): Ministerial regulation of the revised NQF (and sub-frameworks)

The White Paper on a Post School System (Dec 2013): Provides a vision for the post school system


9

The Department of Higher Education and Training has created significant changes in terms of the Acts relating to colleges, but appears to be vacillating iro the suite of qualifications it wishes to offer: NC(V) task team report has been finalised and certain changes proposed, but the debates on the future of the NCV continue; uncertainty regarding the location of the N1 – N3 programmes continue

The Department of Basic Education is implementing the CAPS - Umalusi is currently analysing the changes made to the curricula and the standard of the assessments

The fate of adult learners remains uncertain as a decision has been taken to extend the Senior Certificate. This decision may affect planning for the roll out of the NASCA.


10

Umalusi sets and maintains educational standards and assures quality through a combination of processes and interventions. The 2012/2013 quality assurance regime included the following:

- Evaluation and benchmarking of existing qualifications and curricula (Intended curriculum) and issuing authentic certificates; development of new qualifications and curricula

- Ensuring through external moderation processes that assessments at exit points are of an acceptable standard and that examinations are conducted in a credible manner through verifying the national and provincial monitoring systems (Examined curriculum)

-

Quality Assurance Regime 2013/2014

11

- Ensuring that standardisation processes are reliable, consistent and that standardization decisions are upheld during resulting

- Accrediting private institutions (schools, FET colleges and Adult Centres) to offer the qualifications Umalusi certifies (enacted curriculum)

- Accrediting private assessment bodies to offer / assess the qualifications Umalusi certifies and monitoring of public assessment bodies

Quality Assurance Regime 2013/2014

12

The role of QCC is to ensure and enhance the status and quality of the qualifications Umalusi certifies. Quality assuring the qualifications and their related curricula is QCC’s contribution to the overall quality of the certificate which Umalusi issues. This function also oversees the issuing and verification of certificates.

(Qualifications: SC; NSC; N3; NCV 2,3,4; GETC: adults)

Qualifications, Curriculum & Certification Unit (QCC)

13

Qualifications, Curriculum & CertificationApril 2013 – March 2014 COMMENT

SQualifications Sub-framework

The GFETQSF was gazetted by SAQA (August 2013);

NASCA registered on the NQF, December 2013. Umalusi provided guidance iro NASCA curriculum development.

The General Education and Training Certificate (GETCA) published for public comment to replace GETC: ABET.

Policies regarding the management of qualifications, curricula and certifications reviewed

Qualifications Standards Committee met as per plan

DBE and Umalusi review of the Senior Certificate

Relationships with Departments, SAQA, QCs maintained

Completed as per plan

14

Qualifications, Curriculum & CertificationApril 2013 – March 2014 COMMENTS

Curriculum evaluated and benchmarked:

FET CAPS project prioritized – 15 subjects analyzed; and benchmarked; exit level attainment established. Reports being finalized for publication and dissemination (June 2014)

Longitudinal study across the four phases of schooling planned (CAPS)

Being undertaken as per plan

Certification :

Certification systems (all qualifications) developed and/or enhanced

Certification for all qualifications undertaken as data is submitted. 2013/14: 1 053 927 certificates issued

Verification undertaken as per service level agreements. 2013/14: 275 207 verifications undertaken.

Issued in line with directives and guidelines

15

This function entails establishing, maintaining and improving standards and quality in assessment at exit points in General and Further Education and Training. In order to fulfil this function, Umalusi uses five key processes:

external moderation of question papers; verification of monitoring the conduct of examinations; external moderation of marking; external moderation of continuous assessment; and standardisation of assessment results.

(Qualifications: SC; NSC; N3; NCV 2,3,4; GETC: adults)

Quality Assurance of Assessments Unit (QAA)

16

Quality Assurance of AssessmentApril 2013 – March 2014 COMMENTS

Ext Moderation of Question Papers:

NSC: 355 question papers (DBE + IEB )

26 trial question papers (SACAI)

ABET : 86 question papers (DHET + IEB)

NCV level 2-4 : 264 and (NATED) 88 question papers

SC : 77 question papers


Reports submitted to the Ministers of Basic and Higher Education on all 2013 exams

Moderation of marking:

NSC: 57 subjects (All on site)

ABET: 17 learning areas across PDE’s & 7 learning areas (IEB)

NCV level 2 -4 : 90 subjects and (NATED) 41 subjects

Completed per plan


17

Quality Assurance of AssessmentsApril 2013 – March 2014 COMMENTS

Internal assessment:

NSC: Phase 1- 8 subjects across 4 PDE’s

Phase 2 - 8 subjects across 9 PDE’s

Phase 3 – 14 subjects across PDE’s ; 12 (IEB)

and 16 (SACAI)

ABET: 26 Learning (SBA Tasks),12 learning areas across 9 PDE’s and 4 (IEB)

NCV: 32 subjects (L2-4) sampled across 50 colleges and (NATED) 38 subjects

All internal assessment moderated as per plan


Verifying monitoring conduct of exams:

NSC: 333 sites

ABET: 91 sites

NCV: 60 sites

SC : 72 sites

All monitoring conducted as per plan


18

Quality Assurance of AssessmentsApril 2013 – March 2014 COMMENTS

Monitoring marking of exams:

SC: 99 sites (72 exam centres )and (27 marking centres)

NSC: 294 sites (DBE); 14 (IEB) and 36 (SACAI)

ABET: 112 sites

NCV: 67 sites and 30 (NATED)


Standardisation:

Assessment outcomesStandardised for 11 examinations (SC, NSC, NCV, N1-N3 and GETC: ABET Level 4).



19

The evaluation and accreditation Unit is responsible for accrediting private institutions through quality assurance of their provision for the qualifications Umalusi certifies.

The unit evaluates; The capacity of education and training providers to

implement registered qualifications and approved curricula; and

The quality of the enacted curriculum in providers i.e. teaching and learning at the required standard

The capacity of assessment bodies to conduct practical, internal, and external assessment of learner achievement at the required standard, leading to the certification of registered qualifications

Evaluation and Accreditation Unit (E&A)

20

Accreditation of Private Providers

March 2013 – April 2014 COMMENTSIndependent Schools: New accreditation process opened in October 2013:491 provisionally accredited schools granted full accreditation118 granted 1 year provisional accreditation572 new applications received

Completed per plan

FET Colleges: New accreditation process opened in Sept 2013:312 applications received 241 accepted (rejected 71)

Registration:265 providers referred to DHET for registration

Completed per plan

AET Centres: New accreditation process opened in Sept 2013:91 applications submitted82 accepted (rejected 09)

Completed per plan

21

Accreditation of Private ProvidersInstitutional Site Visits

April 2013 – March 2014 COMMENTS

Independent schools:

No sites visited – due to the transition between old accreditation process and new accreditation process. Only 1 pilot site visit conducted in March 2014 as part of training. Site visits commenced in April 2014

Per plan

Private FET:

No sites visited – due to the transition between old accreditation process and new accreditation process. Site visits commenced in April 2014; 6 “change of address” site visit conducted

Per plan

Private AET:

No accreditation site visits conducted due to transition between old accreditation process and new accreditation process. Site visits commenced in April 2014

Per plan

22

Evaluation and Accreditation of Assessment Bodies

April 2013 – March 2014 COMMENTSIndependent Examinations Board (IEB) monitored for continued accreditation to assess the NSC

IEB granted provisional accreditation to offer the GETC subject to an improvement plan

Completed per plan

Completed per PAJA

SACAI monitored for continued provisional accreditation to assess the NSC in pilot exam 2013 and “state of readiness” for 2014

SACAI’s performance being monitored

One new application for accreditation received to assess the GETC

Currently in process of accreditation

23

The mandate of the SIR unit is to conduct research as identified by the needs of the organisation and report on the key indicators of quality and standards in general and further education and training; to establish and maintain databases; to lead statistical research and analysis; and to inform and provide statistical support for the work in other units. The SIR Unit also plays a role in organizational and professional development at Umalusi.

Statistical Information and Research Unit

(SIR)

24

Statistical Information and Research April 2013 – March 2014 Comment

A comparative report on the education landscape of thecountries in the Southern African Association for Educational Assessment

Report finalized

Making educational judgments 2 Report finalized

National Senior Certificate matriculation results aspredictors of academic success in higher education

Report finalized

Re-thinking ABET and community education – some thoughts on curriculum issues for adults’

Report published

The Future of Rural Education: Research and Teaching Report published

Towards a construct for assessing high level language ability in the National Senior Certificate examinations.

Report published

Item Response Theory - Related research conducted Ongoing

25

Governance and Office of the CEO (GOCEO)

This unit ensures that: Strategic and Annual Performance Plans are in place and that the organisation carries out its remitCorporate Governance as per King 111 is implementedUmalusi’s work is advocated through a Communications and Public Relations strategyStakeholder relationships are built and managed

26

Governance and Office of the CEOApril 2013 – March

2014COMMENTS

Strategic and annual performance plans developed, implemented and monitored

New planning cycle developed and organisational reports published as required

Policies developed and implemented after Council approval

Performance evaluated and monitored quarterly

Organisational governance maintained

Council meetings conducted, committees supported and services rendered

PR and communications strategy implemented

Communication strategy implemented per plan

Stakeholder relationships established and managed

Relationships forged and maintained with political structures, DBE, DHET and other statutory and quality assurance bodies

27

Information Technology Infrastructure & Systems

28

April 2013 – March 2014 COMMENTS

Hardware procured

•213 computer components•10 digital projectors•9 iPads•30 laptops•3 printers•1 R720 Server

Equipment installed with SLA’s implemented and network support meeting expectations.•59 personal computers in total•23 servers in total•58 laptops in total•360 network points (includes the telephone points) in total•10 iPads in total

Software

23 different applications Software licensing up to date.

Network support

Business continuityDisaster Recovery plan maintained. Implemented a VPN through Sita.

Information Technology Infrastructure & Systems

29

April 2013 – March 2014

COMMENTS

Management Information system

• MIS project is ongoing improving operational output• Umalusi web site maintained and supported• Online accreditation system for private providers

implemented

Mainframe Systems

•Certification system

•Verification system

•Quality Assurance systems

• Supported certification and the issuing of certificates for SC, N3, NCV, NSC and GETC

• Submitted data of learner achievements to SAQA for recording on the NLRD for the years 1992 to 2012

• Supported the verification of qualifications

• Successfully supported the quality assurance of the examination resulting processes (Standardization and Statistical moderation)

Finance, HRD & Admin SupportApril 2013 – March 2014 COMMENTS

Finance, SCM and buildings

Unqualified audit (history of organization)

Creditors were paid within 30 days

Surpluses invested at CPD

All assets registered and labeled

Clean audit this year.

Internal renovations to building successful despite space constraints, therefore requested for purchase of additional premises next door

Human Resources Management & Development

Bursaries to staff – 8

In house training – 4

Short courses – 33

All 89 staff benefitted

Vacancy rate – 12 %

Turnover rate – 6 %

Development of staff a priority with greater budget demands for 2013/14 and beyond

30

Financial Performance 2013/14Revenue Amount

Certification, verification and accreditation 20 613 614

Department of Basic Education Grant 97 662 000

Interest and other income 2 857 505

Total Income R 121 133 119

Expenditure 101 529 647

Surplus R 19 603 472

The surplus is due to :•Increased accreditation applications

•Private FET college fee collections increased

•Interest income from reserves still not expended

•Reduced expenditure due to approval of posts to be filled over two financial years.

31

Financial Position 2013/14Assets 37 640 497

•Property & equipment 37 485 127

•Intangible assets 155 370

Current Assets 50 924 402

•Trade & other receivables 4 186 696

•Cash & cash equivalents 46 737 706

TOTAL ASSETS R 88 564 899

Equity 73 689 836

• Accumulated surplus 65 493 214

• Revaluation reserve 8 196 622

Liabilities 14 875 063

•Trade & other payables 9 578 740

•Provisions 5 296 323

TOTAL EQUITY & LIABILITIES R 88 564 899

32

UMALUSI 3 YEAR FORECAST

33

2014/15 2015/16 2016/17 2017/18

R 134 808 098 R 151 523 147 R 173 409 843 R 193 296 806

R 107 354 000

Shortfall-------→

R 112 705 000

R 16 884 016

R 118 678 000

R 33 836 343

R 124 612 000

R 42 361 804

Budgets are expected to increase by CPI, but in Umalusi’s case true inflation costs like travel, accommodation, flights, etc. are way above CPI.

Y/Y Percentage Increase

22% 12% 14% 11%

10% 5% 5% 5%

Total Income 2000/01 (actual) to 2017/18 (budget)YEAR REVENUE BUDGET DBE GRANT GRANT%

2000/01 R 6,150,786 R 0 0

2001/02 R 7,027,948 R 0 0

2002/03 R 13,757,861 R 1,513,000 11

2003/04 R 18,076,902 R 3,050,000 17

2004/05 R 23,547,626 R 12,869,000 55

2005/06 R 28,603,979 R 7,690,000 27

2006/07 R 32,972,345 R 10,286,000 31

2007/08 R 36,013,566 R 12,652,000 35

2008/09 R 46,434,368 R 16,044,000 35

2009/10 R 52,442,731 R 16,494,000 31

2010/11 R 59,464,754 R 17,350,000 29

2011/12 R 92,219,718 R 18,391,000 20

2012/13 R 81,527,016 R 42,330,000 52

2013/14 R 121,133,119 R 97,662,000 81

2014/15 R 134,808,098 R 107,354,000 84

2015/16 R 151,523,147 R 112,705,000 74

2016/17 R 173,409,843 R 118,678,000 68

2017/18 R 193,296,806 R 124,612,000 64

34

Implementation of the GFETQSF (new qualifications and implications for QA processes, curriculum development , different interpretations of mandate, scope of the sub-framework)

Setting standards for the GFETQSF (Norm referenced to Criterion referenced – use of IRT)

New accreditation processes – roll-out Budget requirements in the years going forward

i.t.o. grant

Current Issues and the Way Forward

35

Umalusi wishes to thank

the Honorable Chairperson of the

Portfolio Committee, Mrs. LL Zwane

and

the members for their ongoing support

Conclusion

36

Presentation of the Umalusi 2013/14 Annual Report to the Select Committee on Education and...

Documents

Transcript of Presentation of the Umalusi 2013/14 Annual Report to the Select Committee on Education and...