Portfolio Committee on Basic Education Report on the Quality Assurance of the National Senior...
-
Upload
amanda-nicholson -
Category
Documents
-
view
213 -
download
0
Transcript of Portfolio Committee on Basic Education Report on the Quality Assurance of the National Senior...
Portfolio Committee on Basic Education
Report on the Quality Assurance of the National Senior Certificate
(NSC)
Tuesday, 3 March 2015
Dr Mafu S Rakometsi
WHAT CAN WE LEARN FROM THE NSC RESULTS?
Introduction to the context, principles, approaches and
processes Dr Mafu S Rakometsi, Chief Executive Officer of Umalusi
Regulatory Framework
Quality Assurance of AssessmentNQF Act Section 27 (h) The Quality Council (QC) must develop
and implement policy and criteria for assessment for the qualifications on its sub-framework.
Section17 of the GENFETQA Act(5) The Council must, with the concurrence of the Director-
General and after consultation with the relevant assessment body or education institution, approve the publication of the results of learners if the Council is satisfied that the assessment body or education institution has —
(i) conducted the assessment free from any irregularity that may
jeopardise the integrity of the assessment or its outcomes;
(ii) complied with the requirements prescribed by the Council for
conducting assessments;
(iii) applied the standards prescribed by the Council which a learner is required to comply with in order to obtain a certificate; and
(iv) complied with every other condition determined by the Council.
Framework for Quality Assurance of Learner Achievement
Based on established and existing practices in assessment for certification
Prescribed components of external assessment (examinations) and Site-based/ internal / continuous assessment
Use of systems, processes, and procedures to evaluate, inspect, monitor and report on examination systems, processes and procedures of public and private assessment bodies
Framework for Quality Assurance of Assessment
Evaluation and /or accreditation of assessment bodies;
Periodic inspection of assessment systems; Ongoing monitoring of assessment systems;
and Quality assurance of external examinations
through: Moderation of examination question papers Monitoring and moderation of SBA Monitoring the conduct of examinations Moderation of marking Standardization of assessment outcomes
Approval for the release of Results
Approval is based on the following requirements:
the examinations are conducted compliant to the applicable policies regulating the conduct and administration of the examinations; and
at the time of approval, there is no serious irregularity which could undermine the credibility of the examinations.
Quality Assurance of the DBE 2014 National Senior Certificate
Examination
Ms Faith Ramotlhale
Senior Manager: Quality Assurance of Assessment
Moderation of question papers
PURPOSE:
To ensure that the question papers are of the required standard - (CAPS and SAG’s);
To ensure that the question papers are relatively:- fair- reliable- representative of an adequate sample of the
curriculum - representative of relevant conceptual domains
- representative of relevant levels of cognitive challenge
Moderation of the question papers
Approach:
Question papers set by panel of examiners – DBE
Internally moderated by DBE
Externally moderated by Umalusi
Subsequent moderations and approval
Moderation of the question
papersCriteria:
Technical criteria
Internal moderation
Content coverage
Text selection, types and quality of questions
Cognitive demands
Marking memorandum/guidelines
Language and bias
Predictability
Moderation of the question papers
Areas of Good Practice:
Percentage of question papers and memoranda approved after first and second moderation (Nov’ 2014 - 79% ; Mar’ 15 - 82%)
To ensure equivalence of standards, the final and supplementary examination question papers are moderated simultaneously.
Areas of Concerns
6 question papers were approved in August 2014 after the fifth moderation;
The use of analysis grids for content and cognitive levels;
(IsiXhosa FAL P1 &2; IsiXhosa HL P2; Nov’14 and March’15).
Moderation of the question papersDefinition and Purpose:
Internal assessment refers to any assessment conducted by the provider , the outcome of which count towards the achievement of the qualifications
Ascertain the degree to which assessment bodies/DBE is attempting to ensure standardisation across
Ascertain the standard and quality of the tasks
Establish the extent and quality of internal moderation and feedback
Verify the reliability and validity of the assessment outcomes
Moderation of Internal Assessment
Approach:
Approach Focus Subjects
Provincial Feedback on the SBA Moderation during March/ April’ 2014
Verification of the DBE SBA Moderation during June/July 2014
Verification of SBA moderation - Umalusi independent sample Oct/Nov’2014
Mathematics, Life Sciences, Physical SciencesAccounting, English FAL, History, Geography, Life Orientation, Music, Mechanical TechnologyAgricultural TechnologyComputer Application Technology, Civil Technology, Dramatic Arts, Maths Lit
Moderation of Internal AssessmentAreas of good practice: Internal moderation was conducted at three levels
in some subjects, and well structured moderation process was in place
DBE moderation was found to be rigorous, brief, relevant and feedback was provided to teachers and learners
Generally, the SBA programme was managed appropriately, and the work schedule was adherence to
In some provinces marking was generally fair, marks were transferred accurately and marks were captured and calculated electronically
Moderation of Internal AssessmentAreas of concern: Shadow marking, and incorrect allocation of marks
have a negative effect on the validity, reliability and fairness of the SBA – at school and district level
Marking was too lenient , wide gap between marks scored in tests, examinations and practical tasks, and essay matrix levels were applied inaccurately
The use of rubrics still presents a major problem for teachers, and the marking rubrics for assignments, research projects, and practical investigations were poorly designed
Inability of learners to answer questions of a higher cognitive order, and poor research skills were noted in many subjects
Monitoring of ExaminationsState of readiness Umalusi shadowed the DBE in all provinces, and
conducted independent verification of 82 district offices and a few schools
Findings: Areas of Concerns: Staff capacity is inadequate with a high number
of vacant posts in PDE’s and districts Inadequate resources at PDE’s and District
offices Co-ordination between PDE head office and
District needs improvement
Monitoring of ExaminationsState of readiness High number of independent centres, lack of
capacity to audit them may affect the credibility of examinations
Areas of Good Practice: DBE standardized the turnaround times nationally
for distribution of question papers and return of answer scripts
Most PED have the necessary security arrangements in place
Piloting of electronic locking system in one province
Most PDE’s have adequate to excellent printing, storage and distribution facilities
Monitoring of the writing phase
Procedure:
Umalusi reviewed the sampling procedure
Centres offering SC and NSC had records of irregularities, high enrolments, record of performance, whistle blowers
Areas of Good Practice:
In most provinces appropriate practices were followed and examination regulations were adhered to
No of exam centres No of exam centers monitored by Umalusi
No of Umalusi monitors
6704 359 90
Monitoring of the writing phaseSome examination centres had resident monitors
assigned for the full duration of the examination.
Areas of Concerns:
Delivery of examination material to rural nodal points was not always on time, and poor record keeping of examination material collected
Inadequate monitoring by assessment bodies in some provinces
Training of chief invigilators and invigilators should be intensified in certain provinces so that compliance to examination regulations is adhered to
Training of candidates on examination rules should be enhanced
Monitoring of marking phase
Areas of Good PracticeMarking centres were generally well organised and suitable for the task
Adequate and experienced security personnel at the gates and entrances to the venues in most provinces; and
Training of marking personnel was generally thorough and effective
Areas of Concerns:
Poor marking facilities, and shortage of ablution facilities
Late arrival of markers and load shedding hampered progress
Number of marking centres
132 No of marking centres monitored
104
Monitoring of Marker Selection
PURPOSE:
To monitor the marker selection process with the view to establishing a benchmark for the practices employed in the selection and training of markers:
Umalusi monitored the following processes: Process of marker selection Audit of marker selection Training of various levels of markers Criteria used for marker selection:
Resolution 6 of 1997 as amended in 2001
Monitoring Marker Selection Gauteng: (Performance of learners at 60%) Shortage of applications for English HL – decrease
number of Senior markers and extension of the marking period
Limpopo: No documentation/ evidence to verify the list of
applicants Marker experience was captured incorrectly List of markers declared incompetent during
previous year was not available Discrepancies in the appointment of marking
personnel: Unqualified Senior Markers supervising highly qualified and experienced teachers
Unqualified markers with no subject specialization Grade 10 teachers, principals, and teachers who
were not teaching literature
Monitoring of Marker SelectionMpumalanga
Each panel had the pass rates of schools for the previous year and verified against the application form
There were anomalies in the appointment of Physical Science P2 markers: teacher with PTD and ACE, incomplete forms accepted, Grade 10 teachers, incompetent teachers; inexperienced Senior markers
Placement battery Test administeredNorth West The process was thorough, corroboration of
application forms, school performance, and 2013 performance evaluation
The marker selection and appointment was not compromised, and training of markers was conducted satisfactory
Monitoring of Marker Selection
Kwa-Zulu Natal Though pass percentage was captured it was
not considered as a selection criteria , markers with 29% of learner performance were selected to mark Physical Science
Pass percentage was considered for Chief Marker positions
The monitoring of the process by Umalusi was not well received
Free State The criteria were used without any
enhancement, no deviation from PAM.
Monitoring of Marker Selection
Northern Cape The markers were ranked according to ranking
criteria designed by the PDE:- classroom performance, quality of marking in the previous marking sessions
Discrepancies in the appointment process were observed:
Inexperienced and unqualified chief markers and internal moderators were appointed in certain papers;
2 markers without credentials were appointed in Life Sciences P1.
Monitoring of Marker Selection
Western Cape Competency test administered in 11 gate way
subjects Markers were expected to obtain 60% Two years teaching experience of Grade 12
between 2012-2014 Consistency in the application of the selection
criteria Training of markers covered all aspects of
marking
Eastern Cape: Selection criteria -school performance resulted
in the shortage of markers, thus more than 10% of novice markers were appointed
PURPOSE: Moderation of marking determines the standard
and quality of marking and ensures that marking is conducted in accordance with agreed practices
Umalusi engages with the following processes during the moderation of marking:
Pre-marking/memorandum discussion: centralised memo discussions recommended - this will ensure consistency across provinces and marking centres
Moderation of marking (centralised and on-site)
Verification of marking
Marking verificationMemo discussion meetings:
Areas of good practice:
The memo discussions for the approval of final memoranda went relatively well in 2014
Improved training in most subjects was observed and the introduction of the tolerance range is highly commendable
Few changes were made to marking guidelines for enhancement of marking
Memo discussion meetings (cont)Areas of concern: Provincial representatives often experienced
problems accessing a sample of scripts to pre-mark before coming for memo discussion meetings
The time between the marking dates and the memo discussions was too tight to allow pre-marking to take place
This was reported in several subjects, and seriously compromised the validity of the process, as meaningful discussion and consistency depends on the pre-marking of scripts
Memo discussion meetings (cont)
Areas of concern: Some provinces sent only one representative
or none at all to the memo discussions The fact that the memo discussions for African
languages, HL, SAL and FAL took place in the same time slot caused problems because these subjects share national examiners, internal moderators and external moderators
Where training occurred in FAL and SAL papers, it was compromised as the time allocated was too short
SeSotho HL P2 up to 60% of the memorandum was changed with many alternatives added
Verification of Centralised & on-site marking
Areas of good practice:
Computer Application Technology (CAT) consultation model with national internal and external moderators is commendable for ensuring consistency of marking across the provinces
The intensive and extensive training of markers had a positive effect on the quality of marking
Verification of Centralised & on-site marking (cont)
Areas of concerns:
Candidates had difficulty in the interpretation of specific verbs that denoted to cognitive level of questions
Appointment of incompetent personnel as chief markers
The official rubric for creative writing needs further refinement as it has advantaged candidates in the higher categories
Appointment of incompetent internal moderators- unauthorised additions to the marking guidelines
Verification of Centralised & on-site marking (cont)
Areas of concerns:Inadequate number of internal moderators compromises the rigorous moderation of scripts
Mistakes in the marking may be attributed to non compliance to the marking memorandum by markers
Examination Irregularities The marking moderation process was intensified by
deploying external moderators to the 9 provinces for the extended period and independent sampling of scripts
Irregularities that occurred in Mpumalanga, KZN and EC were identified during the verification of marking process at the various marking centre
Subjects that were implicated were mostly high enrolment subjects, namely Mathematics, Physical Science, Life Sciences, English FAL, Geography, History, and Business Studies and Accounting
DBE was informed to conduct an audit in the affected subjects and centres- Umalusi oversight role
Examination Irregularities DBE conducted an audit in the two provinces and
presented the outcome of the audits involving irregular patterns in the learners’ scripts; 39 centres were identified in KZN and 19 centres in the Eastern Cape
Umalusi’s external moderators and internal staff were deployed to the provinces to monitor and verify the outcome of the audits
DBE recommended the clearance of additional centres to EXCO, and after Umalusi verification additional centres were cleared in KZN and in the Eastern Cape;
DBE and EC Chief Director presented reports to EXCO from their investigation (candidates, invigilators and chief invigilators), - Umalusi oversight role
Examination Irregularities Methodology differed- EC invigilators, Chief
invigilator and candidates were interviewed by one team on the same date; objectivity and professionalism was observed
KZN- invigilators and chief invigilators were interviewed separately from candidates with the difference of a week in between by different panels; - subjectivity and lack of professionalism observed
The number of implicated centres stood at 20 in KZN and 14 in the Eastern Cape, the results of the implicated candidates were blocked pending the outcome of the hearings with candidates
Examination Irregularities Meetings were held between Umalusi and DBE
Senior Management; Umalusi Chairperson of Council and the Minister to map out the way forward; and conflicting views presented by media
DBE will provide Umalusi with the plans for the conduct of the formal hearings in the two provinces- scheduled in March/April 2015
Examination IrregularitiesProvince Number
of CentresOutcome
Gauteng 6 Hearings in progress
Mpumalanga 3 Results cleared in Accounting
Western Cape 1 Implicated candidates barred for 1-3 years;
North West 1 Implicated candidates barred for 1-3 years
Northern Cape 1 Implicated candidates barred for 1-3 years
Eastern cape 14 Results blocked pending hearings
KZN 20 Results blocked pending hearings
Standardisation and verification of resulting
Provision of GENFETQA – Council may adjust
raw marks International practice – large scale
assessment systems Standardisation – process used to mitigate
the effect of factors other than learners knowledge and aptitude on the learners performance
Sources of variability – difficulty in question paper, undetected errors, learner interpretation of questions
Verification of the Resulting Process
Planned Status
Subject structures Subject structures verified
Candidate registration System verified during state of readiness visits
Generation of mark Sheets Monitored
Capturing of Marks Monitored
Standardisation data & Booklets
Data sets received and verified
Capturing of adjustments Verified
Statistical moderation & resulting
Verified
Statistical moderation
Scope of standardisation 2014:
Decision Number of subjects
Subjects standardised 58 Subjects
Raw marks accepted 35 subjects
Moderated Upwards 13 Subjects
Moderated Downwards 10 subjects
SUBJECT ADJUSTMENT
Physical SciencesFrom 0 to 107 : RawFrom 107 to 300 : CA
Mathematics
From 0 to 150 : RawFrom 150 to 246 : Scale (0 to -6)At 300 : Scale to 0
Geography
From 0 to 76 : Scale (0 to -10) From 76 to 136 : Block of -10 From 136 to 212 : Scale (-10 to 0) From 212 to 300 : CA
English HL
From 0 to 37 : Raw From 37 to 114 : Scale (0 to +6)From 114 to 137 : Scale (+6 to+5 )From 137 to 300 : CA
SUBJECT ADJUSTMENTLife Sciences ½ CA
History ½ CA
Electrical Technology ½ CA
IsiZulu HL, Sesotho HL, Setswana FAL
½ CA
SUBJECT ADJUSTMENTMathematics Literacy, CAHospitality Studies CAReligious Studies CABusiness Studies CAAgricultural Management Practice, Agricultural Technology CAInformation Technology, Engineering Graphics and design CAisiNdebele HL, Sepedi HL, Sepedi FAL.
CA
SUBJECT ADJUSTMENTAgricultural Science; Raw Tourisms, Consumer Studies RawDance Studies, Design , Dramatic Arts, Visual Arts, Music RawCAT, Civil Technology, Mechanical Technology RawAccounting, Economics, RawSesotho SAL, Sesotho FAL, Sepedi SAL, Setswana HL
Raw
Afrikaans HL, English SAL, English FAL
Raw
IsiXhosa HL, IsiXhosa SAL, IsiSwati HL, isiNdebele FAL, IsiNdebele SAL, IsiZulu FAL, IsiZulu SAL, IsiSwati SAL, IsiSwati FAL
Raw
SUBJECT ADJUSTMENTXitsonga HL, Tshivhenda HL, Tshivhenda FAL, Xitsonga FAL,
Raw
Life Orientation Raw
Statistical moderation
Areas for Concern
Some recommendations for adjustments were not in line with the principles of standardization
Essay questions that were left out of English
FAL remains a concern
Late submission and inaccurate standardisation data delays the approval of results
Quality Assurance of the Independent Examinations Board
(IEB) 2014 National Senior Certificate Examination
Ms Faith Ramotlhale
Senior Manager: Quality Assurance of Assessment
Moderation of the question papers
Areas of Good Practice: Percentage of question papers and memoranda
approved after first and second moderation (97% Nov 2014/ March 2015)
In general, the IEB internal moderation was of high standard, as evidenced by many papers that were approved at first moderation (72 papers)
Directives for compliance: Since CAPS is new, cognitive level grids have
been reviewed training of examiners for the interpretation and analysis and balancing cognitive levels of questions
Moderation of the question papersAreas of concern:
The criteria for text selection, cognitive levels and language bias should be given attention to address the papers that were subjected to third moderation
The consistent failure of both examiners and internal moderators to address the problems that led to low compliance levels in some papers
Moderation of Internal Assessment
Term 4 moderation- focus on learner evidence and
teacher files IEB Subjects
Mathematics, Maths Lit, Life Sciences, Geography,Physical Sciences, Accounting, English HL, History, Life Orientation, Business Studies, Economics, Afrikaans FAL,
Moderation of Internal AssessmentFindings: Areas of Good Practice The teachers and learners are files were well
presented The IEB monitoring processes is rigorous, as
evidenced by high compliance in the adherence to policy criterion
CAPS workshops were conducted
Findings: Areas of Concern The use of previous years question papers without
adjustment as assessment tasks lacks originality Errors found in assessment instruments and
marking guideline attributed to lack of pre-moderation
The erroneous awarding of marks compromises the reliability and validity of SBA marks
Monitoring of the writing phase
Scope:No of exam
centresNo of exam
centers monitored by
Umalusi
No of Umalusi deployed for IEB
monitoring
184 20 15
Monitoring of the writing phase
Findings:
Management of the examinations: The implementation of the electronic
locking system for question papers and answer scripts is innovative and reduce security risks
The school facilities and the environment was generally good and conducive to the writing of examinations
Adherence to the examination regulations Adequate and appropriate security systems
Monitoring of the writing phase
Absence of serious irregularities commendable
Areas of concerns:
The conduct of audits of ablution facilities prior to the commencement of writing posed a security risk
Some centres did not allocate time for checking the question papers this might disadvantage candidates if there are technical irregularities
Monitoring of the writing phase
Scope
No of marking centres
No of marking centers
monitored by Umalusi
No of Umalusi deployed for IEB
monitoring
2 2 1
Monitoring of the marking phase
Scope:
Facilities used for marking were of the acceptable standard, safety and security measures were in place
The standardisation of marking guidelines and training of marking personnel was conducted appropriately
Verification of markingFocus:
Memo discussion and on-site marking verification
Areas of good practice:
100% participation in memo discussions, discussions of potential problems and alternative answers
Verification of marking
Areas of improvement:
A need to modify the time allowed for memo discussions in order to deal with cases for ill prepared markers
To avoid too many changes to the memorandum it might confuse markers
Verification of marking (cont)Areas of Good Practice
The selection of senior markers is based on merit onlyExperienced markers were assigned to mark the more challenging questions
Areas of concern
Lack of differentiation of the levels of moderationMark allocation and breakdown of marks was cited as a serious concernThe changes to the memorandum did not follow due process, nor Umalusi moderators have control over the process
Statistical moderation
Scope of standardisation 2014:
65 subjects standardised
Raw marks accepted: 43 subjects
Moderated Upward : 7 subjects
Moderated Downward : 15 subjects
Statistical moderation
Areas of concern:
Adherence to prescribed colors as prescribed in the directives for specification and requirement for standardization
Lack of IT personnel on standby during the standardisation period
SUBJECT ADJUSTMENT
Accounting
From 0 to150: RawFrom 150 to 244: Scale (0 to -4) From 244 to 300: Scale (-4 to 0)
Hebrew SAL From 0 to 300: Block+7
Life Orientation
From 0 to 83: RawFrom 83 to 237: Scale (0 to +3) From 237 to 300: Scale(+3 to 0)
Arabic SAL; English FAL; French SAL;
CA
Life Sciences; Physical Science
CA
Economics; Sports Sciences
CA
SUBJECT ADJUSTMENT
Business Studies; ½ CA
History, Geography ½ CA Design, Visual Arts, Dramatic Arts
½ CA
Hindi SAL, ½ CA
Sesotho FAL, Setswana FAL
½ CA
Marine Economics½ CA
SUBJECT ADJUSTMENTAfrikaans FAL, Afrikaans HL, English HL,
Raw
German HL, German SAL, Gujarati FAL, Gujarati SAL, Hebrew SAL, Hindi FAL, Urdu FAL, Urdu SAL, Latin SAL; Modern Greek SAL, Portuguese SAL; Spanish SAL, Tamil FAL, Tamil SAL, Telegu SAL
RawIsiXhosa FAL, IsiZulu HL, IsiZulu FAL, SiSwati HL, SiSwati FAL, RawXitsonga FAL, Sepedi HL Raw
SUBJECT ADJUSTMENTTourism, Hospitality, Consumer Studies
Raw
Music, dance Studies, Raw
Computer Applications Technology, Civil Technology, Information Technology, Engineering Graphics and Design,
Raw
Mathematics and Mathematical Literacy
Raw
Equine Studies, Nautical Science Raw
Advanced Programme in AfrikaansAdvanced Programme in EnglishAdvanced Programme in Mathematics
Raw
Quality Assurance of the South African Comprehensive
Assessment Institute (SACAI) 2014 National Senior Certificate
Examination
Ms Faith Ramotlhale Senior Manager: Quality Assurance of Assessment
Moderation of the question papers
Areas of Good Practice: Percentage of question papers and memoranda
approved after first and second moderation ( 82% Nov 2014)
Directives for compliance: Non compliance to CAPS guidelines Papers approved after the fourth and fifth
moderation Re-use of questions from previous papers
promotes predictability Internal moderation was sub-standard
Moderation of the question papers
Directives for compliance:
High levels of non compliance in the area of internal moderation, content coverage, and cognitive levels
Failure of both examiners and internal moderators to interpreted and analyse cognitive levels
Submission of question papers with many technical errors
Moderation of Internal AssessmentApproach:Approach Focus Subjects
Verification of the SBA Moderation during August 2014
Verification of SBA moderation - Umalusi independent sample Nov’2014
13 gateway subjects were moderated
14 gateway subjects were moderated
Moderation of Internal Assessment
Areas of Good Practice:
Compliance level on technical aspectsGood practice was observed in Agricultural Science, History, Business Studies and Economics in the final moderation
Areas of Concern:
The quality of internal moderation remains a concernLack of constructive feedback to learners was observed in most subjects
Moderation of Internal Assessment
Areas of Concern:
Non compliance in terms of the standard of tasks, rubrics, and the use of marking tools was still observed in November
The use of common papers that do not conform to CAPS persists
Learners performed well in internal examinations but poorly in preliminary examinations
Monitoring of Writing
Scope:
No of marking centres
No of Marking centres
monitored
No of Umalusi monitors
deployed to SACAI
65 10 5
Monitoring of writingAreas of Good Practice:
Invigilators arrived early in the examination rooms
Sufficient time was allocated for the admission of candidates to the examination room and to perform other exam related administrative duties
Areas of Concern:
Training of invigilators was not conducted at some centres
Lack of mark sheets in some of the centres
Monitoring of the writing Non adherence to the examination time table
might have compromise
Security at some centres was substandard, keys for strong rooms were kept by cleaners
Monitoring was not conducted extensively by the assessment body
Appointment of markers was questionable, as no proof of appointment was observed in some of the centres
Monitoring of marking
Areas of good practice:As a new assessment body no major systemic irregularities were identified or reportedHighly satisfactory facilities for marking are commendable
Areas of Concerns:The security of the marking venue was inadequate lack of security guards at the marking doors
Memorandum Discussion
Area of Good practice:
High number of subjects in which potential problems were discussed and changes were made to the memorandum with in-depth discussions and rigour
Areas of concern:
Too many changes were made to the memoranda soaring 55 changes in Business Studies
Verification of Marking
Areas of good practice:
The verification of marking was thorough during marking guideline discussion the standard of marking was found to be adequate
Very few instances were found where internal moderators and markers had to improve on marking; where it happened it was technical errors
This assessment body has fairly a small number of candidates, therefore challenges were easily detected and corrected
Verification of Marking
Areas of concern:There are still some novice markers who require further training and guidance especially when assessing higher cognitive level assay questions
Some internal moderators tend to be lax and ignore errors and discrepancies in mark allocation made by some markers this compromises the reliability of scores
The substitution and replacement of accounting markers during the marking process is a worrying factor
Standardisation and Verification of Results
Scope of standardisation 2014:
27 subjects standardised
Raw marks accepted: 24 subjects
Moderated Upward : 3 subjects
Moderated Downward : 0 subjects
Standardisation and Verification of Results
Areas of good practice SACAI standardisation data was presented in
accordance with Umalusi requirements, considering that it was the first NSC examination
Areas of Concern: Incorrect calculations on raw scores and
adjustments in languages; corrections were submitted during the standardisation meeting
There was no alignment between the table of content and the page numbers in the pairs analysis booklets
SUBJECT ADJUSTMENT
Afrikaans HL
From 0 to153 : Raw From 153 to 228: Scale (0 to +12From 228 to 300: Scale (+12 to 0)
TourismFrom 0 to 300 : Block +6
Afrikaans FAL, English HL, English FAL
Raw
Accounting, Economics, Business Studies
Raw
Life Sciences; Physical Science
Raw
History, Geography
Raw
SUBJECT ADJUSTMENTConsumer Studies, Hospitality
Raw
Dramatic Arts, Visual Arts RawComputer Application Technology, Civil Technology, Information Technology, Mechanical Technology, Electrical Technology, Engineering Graphics and Design
Raw
Agricultural ScienceRaw
Mathematics, Mathematics Literacy
Conclusion The findings of the quality assurance processes are a
clear indication of a maturing system that has, on the one hand, made positive strides towards improvement in certain areas of assessment and examination
But on the other hand, still has a few challenges that need to be addressed as the current regulations do not address how systemic irregularities can be addressed
The quality assurance of each of these processes presented above was conducted based on Umalusi criteria. Umalusi uses criteria that are subjected to constant review and refinement, to ensure that they are in line with current trends in assessment and examinations
Conclusion… Despite the group copying in the EC and KZN,
generally Umalusi is pleased with the manner in which the 2014 NSC examination was administered
Umalusi takes this opportunity to express appreciation to the national & provincial departments of education for their concerted effort in ensuring a credible examination
Umalusi expresses appreciation also to all the relevant stakeholders, including whistle blowers who are striving to ensure that credibility and the integrity of the examinations are not compromised