Chapter II:

Accreditation of an Examination System

The application for the accreditation of an examination system may be submitted in the framework of the accreditation for the examination centre, or independently, on the initiative of an already accredited examination centre. The application must comply with Article 9 Section (1) of the Government Decree 137/2008. (V. 16.). In the case of the accreditation of more than one examination systems, separate documentation must be submitted for each examination system. The applicant must indicate the name and type of examination system. They must also declare whether they are applying for the accreditation of a monolingual or bilingual language examination. In the case of specialized language examinations they must declare whether they intend to run profiles within the given specialized language, and if they are, which profiles. The application has to state whether the examination centre intends to operate the examination system in paper-based format, computer-based format or both.

The requirements of the language examination are determined by Appendix No. 2 of the Government Decree 137/2008 (V. 16) (hereinafter referred to as the Decree) and the descriptions of levels B1, B2 and C1 of the Common European Framework of Reference. The requirements of classical languages are different from these.

The accreditation fee is specified in Annex 2 to Ministry of Human Capacities Decree No. 12/2013. (II.12.) about the rules of

administrative proceedings and service fees in connection with tertiary education and the operation of accredited language examinations.

The application for accreditation has to be submitted to the Educational Authority in 2 printed copies and on 2 electronic storage media (CD/DVD) in Word and PDF formats with exactly the same content in both formats according to the Application Form for Accrediting a Language Examination Centre, attaching the required appendices. The application must contain proof that the

accreditation fee has been transferred. The list of documents to be submitted is detailed in the tables below.

A. The accreditation of the examination system can be requested in case the examination system

fulfils the following conditions:

Condition Documents to be attached Comments

1. The examination system is independently developed and possesses unique characteristic features.

II.1. Introduce the unique features of the examination system. II.2. In the case of a specialized language exam, please attach a needs analysis.

2. The examination system has detailed test specifications and official test specifications. The test specifications document details the following:

aim of the exam; target group; level judgement of the exam; concepts the exam has about

language knowledge (its construct, theoretical framework);

the structure and schedule of the exam

weighting of the subtests; typical situations in the target

language; text type and the length of texts; skills to be examined; language elements to be examined

(language content); topics; types of task; standardized instructions (written

exam) and moderation (oral exam) ; grading/assessment criteria; method of assessment, rating scales; determining the minimum

performances for the whole exam or for its parts (e.g. measurement units or partial exam);

II.3. Attach the detailed test specifications document, and the official test specification, which contain the most important elements of the detailed Test Specifications in standardised format and with standardised content prescribed by the Educational Authority. From 01/01/2013 the legal inspections of the examination centres are based on the official test specifications. II.4. In the case of a specialized language exam, introduce the distinctive aspects of how the professional community use the language in the given professional field and also the characteristic features of the specialized language. II.5. Attach two complete model tests. Attach the answer keys of the tests assessing reading comprehension and mediation etc, the audio files for listening comprehension and the answer keys of the objective tasks. Attach videos assessing the speaking element. II.6. Complete the chart detailing the measurement units of a complex language examination. II.7. Introduce the methods used to treat partial results and to summarize the results, the system of weighting (if there is one) and the method used to determine the minimum performance at the exam. When the examination system also issues certificates for

In the case of a language exam in modern foreign languages, the complex language exam must include at least four measurement units. The minimum performances in each skill measured cannot be less than 40 % of the total possible gained at every measurement unit. If an examination system assesses a skill (e.g. mediation) in the case of two subtests (speaking and writing), the candidates must achieve 40% in both subtests in order to pass the language exam. A speaking examination that was accredited and advertised as a paired format examination cannot be administered as an individual format examination. In the case of specialized language exams, a complete test specification is needed for each profile and two model tests with answer keys and assessed performance samples must be attached.

exam samples, or tasks already completed;

method of calculating the results (e.g. post standardisation) ;

In the case of a specialized language exam a description about what a candidate who achieves a given level knows in real life.

partial exams, introduce the way results are summarized and determine minimum performances and the system of weighting.

A specialized language examination system can be accredited if the specialized language complies with the field of education determined by Law CXXXIX / 2005 or listed as part of it. The specialized language exam assesses the knowledge of the specialized language in every language skill.

3. The examination system is valid, measures the CEFR levels (B1, B2 and C1) of language knowledge recognized by the state at each

accredited level, for each language skill and

assesses separately (except the classic languages). The assessment system conforms with the assessment instruments applied and the levels of language knowledge. In the case of tasks assessing the productive skills, the descriptors of the grading scale appropriately reflect the requirements of the given level. The examination system corresponds with the requirements of representativity, neutrality and positive test impact.

The test specifications and 2 model tests (completed with the sample solutions of the writing, mediation tests etc., the audio-files for the listening comprehension tests, the keys of the objective tests and the videos presenting the oral exams) are used to judge the validity of the exam. II.8. Present how far the test types correspond with the actual needs of the target group of candidates regarding the use of language. II.9. In the case of specialized language examinations, describe how the aspects of assessment are adjusted to the aspects typical to the use of specialized language.

The test specification should clearly describe the connection to the Common European Framework of Reference. A system that involves only discrete-point-type tests generating only non-productive language performance cannot be accredited. The exam specification includes the appendices referred to. The validity of the specialized language exam should be traced back to the model of language theory forming its basis and to the results of the needs analysis.

4. The examination system assesses language knowledge in a reliable way at each level.

II.10. Present the data typical to the operation of the examination system and gained when assessing reliability for each language and each level. Demonstrate that in the case of each measurement unit the reliability coefficient, the difficulty and quality of items, the correlation between the measurement units, as well as the inter-rater reliability in case of the subjectively assessed measurement units are within the accepted range of values. The statistical indicators and their acceptable values are listed in the Statistical Requirements chapter of the Accreditation Handbook. In the case of using other comparative procedures, please, attach references in connection with the acceptable levels. If the statistical values do not comply with the requirements, the examination centre prepares a long-term action plan on the basis of the consequences drawn from the analyses in order to improve the reliability and difficulty of the examination. In order to ensure the required quality and difficulty, it is advisable to apply post standardisation procedures. The examination centre informs the examinees about the methods of post standardisation in its Rules of Exam Procedures document. Present how the lessons learned through the analyses are utilized regarding the whole of the assessment system, the development of

The presentation of the procedure(s) should include formulas and their sources. For the connection between the results treated as one and the methods of analysis, please find information here. According to Article 8, Section (2b) of Government Decree 137/2008 (V. 16.), with the exception of the component assessing speaking, a test may not be used in the same format within a year (that is 12 months). A test is considered to have the same format if one of the items is the same, or if one sentence in the source text is the same. At the language exam two assessors assess each language performance of the candidates. Double marking must be documented. See The resolution of the Accrediting Body on double marking & Glossary: examining board Every year at least 20 per cent of the examination tasks related to assessing oral skills have to be changed, unless a different set of examination tasks are used on each examination day and at each examination event within a given year.

new test materials and the training of examiners. In case of language examination centres operating abroad, only the data and statistical analysis in connection with exam events administered in Hungary have to be submitted.

In case of randomisation, if the number of speaking tasks of the speaking pool relating to each level and each language is more than 100, at least 10 per cent of the examination tasks related to assessing oral skills have to be changed. However, each examination centre regularly has to inspect its speaking task pool and has to replace the outdated or badly operating tasks. The process of renewing of the speaking tasks has to be clearly documented, that is the

parameters of use for a given oral task have to be systematically archived: date of entry into the system, dates and locations of use (if during an examination period different sets of examination tasks are used at different examination locations), date of extraction from the system. The documentation has to be kept for 3 years. The examination centre provides for the recurring date of replacing the tests in its Internal Rules of Operation.

Speaking tasks shall not be repeated during two consecutive examination periods and during two consecutive exam events within one examination period. Speaking tasks may be assorted at random (randomisation). For randomisation the examination system/centre needs a task bank that includes at least at least 60 tasks for each paper. Exam papers assigned to the test takers shall not be selected by the examiners.

If the examinee draws the paper at random, the total number of papers in the battery has to be at least two more than the number of test takers. If the number of tasks is less than the above mentioned, the method of scheduled controlled admissions (time locking) has to be used. See Accreditation Board resolution on the application of speaking tasks

An audio recording is made of the speaking exam after the consent of the test taker (see Article 4, Section (1a) of Government Decree 137/2008), The audio recording should be made in a digital format and in a

quality that allows inspection and (re-)assessment, indicating the data and the participants of the examination event. If the recording is not or cannot be made, the examinee has to take the test in front of a three-member Examining Board.

5. Every level of the examination system is standardized with the given CEFR level.

II.11. Present the standardisation procedure conducted in detail (e.g. the description of the familiarization and training phases, the justification of the procedure(s) selected, the aspects of selecting the judges who take part in the judgment-based procedures and control over their reliability, the description of the decision-making mechanisms, the conditions of the examination(s), the processing of data, the method of analyses, etc.). Attach records of meetings where the levels were harmonized with the CEFR levels and the standards were determined together with illustrative examples about the tasks and sample tasks and also about performance at the local oral and written exams. If needed (see Linking the language examination to the CEFR document) attach documentation regarding external validation including statistical analyses.

The degree of standardization of the examination systems to the CEFR may be different. Concerning the procedures of standardization you can find more information in the publication: Relating Language Examinations to the Common European Framework of Reference for Languages and in the Manual for Relating Language Examinations to the Common European Framework of Reference (www.nyak.hu).

6. The examination centre is able to comply with the procedural requirements of the examination efficiently. The examination centre has at least two complete, unused written tests for every examination period. The examination centre regularly collects the opinion of the examiners and the candidates and learns from them.

II.12. Present how the examination system complies with the procedural requirements of the examination. Present how it takes care of permanently used tests. In the case of posterior standardization and correction, describe the process of correction (which tasks, types, subtests and parts of the examination procedure it relates to what

reasons may render it necessary). II.13. Attach the guidelines/manuals made for the test developers and constructors. II.14. Attach the score sheets to be used at the exam and the records of the exam. II.15. Attach a declaration that the centre has at least two complete, unused written tests for every examination period. II.16. Attach the questionnaire/sample questionnaire used to collect feedback from the candidates/examiners. II.17. Attach a signed and stamped declaration of the acknowledgement of Underlying principles for computer assisted exams to the accreditation application of the computer-based examination format in

Section D point 3. II.18. In case of applying for both a paper-based and a computer-based format of the same examination system, attach an impact study about the interchangeability of the two formats.

The differentiation of procedural requirements of the examination depends on the types of tasks used and the amount of data treated together. If you use test banks, explain how the content of the ten phases determined as the procedural requirements of the

examination are modified.

B. The Expansion of the Examination System to Include a New Language

If the examination centre intends to include a new language into the examination system, it has to prove that the tests developed in

the new language suit the examination system, that the tests were developed in the same way as the tests of the language(s) already accredited and that the centre possesses enough examiners necessary to operate the system. In the case of expanding the system with a new language, the monolingual examination systems may be expanded in the pattern of a monolingual examination, while the bilingual system in the pattern of a bilingual examination.

The language examination centre has to submit the application to the Educational Authority in 2 printed copies and 2 electronic data carriers in Word and PDF formats according to the according to the ‘Application for accrediting a new examination languagel’ form, attaching the annexes required, with exactly the same content in both formats. The application must include proof that the accreditation fee specified in Annex 2 to Ministry of Human Capacities Decree No. 12/2013. (II.12.) has been transferred. The list of documents to be submitted is detailed in the table below.

The examination system can be expanded to include another language if it fulfils the following conditions:

Condition Documents to be attached Comments

1. The accredited examination system applies for the accreditation of the new language/languages and pays the accreditation fee.

II.17. List the new language(s) of the accredited system on the front page of the Application.

2. The accredited examination system has an updated test specification for the new language(s).

II.3. Attach the test specification to the application as a separate, removable document. II.5. Attach two complete model tests. Attach the sample solutions for the writing,

mediation tests etc., the audio-files for the listening comprehension tests, the answer keys for the objective tests. Attach videos presenting how the oral skills are assessed.

A speaking examination that was accredited and advertised as a paired format examination cannot be administered as an individual format examination.

3. The new language(s) of the accredited examination system meets the criteria of validity and reliability.

II.10. Present the statistical indicators verifying the validity and reliability of the exam. Attach the documents related to the test development procedure for the new language, in particular to pretesting, their statistical analysis, the use of the results gained, and the method, conduct and results of pretesting. Present how you guarantee that each part of the language performance of the candidates is assessed by two assessors and how the reliability of the assessors is monitored. (See the resolution of the Accrediting Board on double marking.)

4. Each level of the new language(s) of the examination system corresponds to the levels of the CEFR.

II.11. Present the elaborate standardization procedures (e.g. the description of the familiarization and training phases, the

justification of the procedure(s) selected, the aspects of selecting the judges who take part in the judgment-based procedures and control over their reliability, the description of the decision-making mechanisms, the conditions of the examination(s), the processing of data, the method of analyses). Attach records of meetings where the levels were correlated to the CEFR levels and the standards were determined together with illustrative examples about the tasks and sample tasks and also about the performances conducted at the local oral and written exams.

The degree of standardization of the examination systems to the CEFR may be different.

Concerning the procedures of standardization you can find more information in the publication: Relating Language Examinations to the Common European Framework of Reference for Languages and in the Manual for Relating Language Examinations to the Common European Framework of Reference (www.nyak.hu).

If needed (see Linking the language examination to the CEFR document), attach the documents of external validation including statistical analyses.

.

5. The examination centre has at least two complete, unused written tests for every examination period.

II.15. Attach a declaration that the centre has at least two complete, unused written tests for every examination period.

C. The Expansion of the Examination System to Include a New Level

If the examination centre intends to include a new level into the examination system, it has to prove that the tests developed for the

new suit the examination system, and the tests were developed in the same way as the tests of the levels already accredited.

The language examination centre has to submit the application to the Educational Authority in 2 printed copies and 2 electronic data carriers in Word and PDF formats according to the ‘Application for accrediting a new examination level’ form, attaching the annexes required, with exactly the same content in both formats. The application must include proof that the accreditation fee specified in Annex 2 to Ministry of Human Capacities Decree No. 12/2013. (II.12.) has been transferred. The list of documents to be submitted is detailed in the table below.

The examination system can be expanded to include another level if it fulfils the following conditions:

Condition Documents to be attached Comments

1. The examination system is independently developed and possesses unique characteristic features.

II.1. Introduce the unique features of the examination system.

2. The examination system has detailed test specifications and official test specifications. The test specifications document details the

following: aim of the exam; target group; level judgement of the exam; concepts the exam has about

language knowledge (its construct, theoretical framework);

the structure and schedule of the exam

weighting of the subtests; typical situations in the target

language; text type and the length of texts; skills to be examined; language elements to be examined

(language content); topics; types of task; standardized instructions (written

exam) and moderation (oral exam) ; grading/assessment criteria; method of assessment, rating scales; determining the minimum

performances for the whole exam or for its parts (e.g. measurement units or partial exam);

exam samples, or tasks already completed;

method of calculating the results (e.g. post standardisation) ;

II.3. Attach the detailed test specifications document for the required examination level, and the official test specification, which

contain the most important elements of the detailed Test Specifications in standardised format and with standardised content prescribed by the Educational Authority. From 01/01/2013 the legal inspections of the examination centres are based on the official test specifications. II.5. Attach two complete model tests. Attach the answer keys of the tests assessing reading comprehension and mediation etc, the audio files for listening comprehension and the answer keys of the objective tasks. Attach videos assessing the speaking element. II.6. Complete the chart detailing the measurement units of a complex language examination. II.7. Introduce the methods used to treat partial results and to summarize the results, the system of weighting (if there is one) and the method used to determine the minimum performance at the exam. When the examination system also issues certificates for partial exams, introduce the way results are summarized and determine minimum performances and the system of weighting.

In the case of a language exam in modern foreign languages, the complex language exam must

include at least four measurement units. The minimum performances in each skill measured cannot be less than 40 % of the total possible gained at every measurement unit. If an examination system assesses a skill (e.g. mediation) in the case of two subtests (speaking and writing), the candidates must achieve 40% in both subtests in order to pass the language exam. A speaking examination that was accredited and advertised as a paired format examination cannot be administered as an individual format examination.

3. The examination system is valid, measures the CEFR levels (B1, B2 and C1) of language

The test specifications and 2 model tests (completed with the sample solutions of the

The test specification should clearly describe the connection to

knowledge recognized by the state at each

accredited level, for each language skill and

assesses separately (except the classic languages). The assessment system conforms with the assessment instruments applied and the levels of language knowledge. In the case of tasks assessing the productive skills, the descriptors of the grading scale appropriately reflect the requirements of the given level. The examination system corresponds with the requirements of representativity, neutrality and positive test impact.

writing, mediation tests etc., the audio-files for the listening comprehension tests, the keys of the objective tests and the videos presenting the oral exams) are used to judge the validity of the exam.

the Common European Framework of Reference. A system that involves only discrete-point-type tests generating only non-productive language performance cannot be accredited. The exam specification includes the appendices referred to.

4. The examination system assesses language knowledge in a reliable way at each level.

II.10. Present the data typical to the operation of the examination system and gained when assessing reliability for each language and each level. Demonstrate that in the case of each measurement unit the reliability coefficient, the difficulty and quality of items, the correlation between the measurement units, as well as the inter-rater reliability in case of the subjectively assessed measurement units are within the accepted range of values. The statistical indicators and their acceptable values are listed in the Statistical Requirements chapter of the Accreditation Handbook. In the case of using other comparative procedures, please, attach references in connection with the acceptable levels. If the statistical values do not comply with the requirements, the examination centre prepares a long-term action plan on the basis of the consequences drawn from the analyses in order to improve the reliability and difficulty of the examination. In order to ensure the required quality and difficulty, it is advisable to apply post standardisation procedures. The examination centre informs the examinees about the methods of post standardisation in its Rules of Exam Procedures document. Present how the lessons learned through the analyses are utilized regarding the whole of

the assessment system, the development of new test materials and the training of examiners. In case of language examination centres operating abroad, only the data and statistical analysis in connection with exam events administered in Hungary have to be submitted.

The presentation of the procedure(s) should include formulas and their sources. For the connection between the results treated as one and the methods of analysis, please find information here. According to Article 8, Section (2b) of Government Decree 137/2008 (V. 16.), with the exception of the component assessing speaking, a test may not be used in the same format within a year (that is 12 months). A test is considered to have the same format if one of the items is the same, or if one sentence in the source text is the same. At the language exam two assessors assess each language performance of the candidates. Double marking must be documented. See The resolution of the Accrediting Body on double marking & Glossary: examining board Every year at least 20 per cent of the examination tasks related to assessing oral skills have to be changed, unless a different set of examination tasks are used on each examination day and at each examination event within a

given year. In case of randomisation, if the number of speaking tasks of the speaking pool relating to each level and each language is more than 100, at least 10 per cent of the examination tasks related to assessing oral skills have to be changed. However, each examination centre regularly has to inspect its speaking task pool and has to replace the outdated or badly operating tasks. The process of renewing of the speaking tasks has to be clearly documented, that is the parameters of use for a given oral task have to be systematically archived: date of entry into the system, dates and

locations of use (if during an examination period different sets of examination tasks are used at different examination locations), date of extraction from the system. The documentation has to be kept for 3 years. The examination centre provides for the recurring date of replacing the tests in its Internal Rules of Operation.

Speaking tasks shall not be repeated during two consecutive examination periods and during two consecutive exam events within one examination period.

Speaking tasks may be assorted at random (randomisation). For randomisation the examination system/centre needs a task bank that includes at least at least 60 tasks for each paper. Exam papers assigned to the test takers shall not be selected by the examiners.

If the examinee draws the paper at random, the total number of papers in the battery has to be at least two more than the number of test takers. If the number of tasks is less than the above mentioned, the method of scheduled controlled admissions (time locking) has to be used. See Accreditation Board resolution on the application of speaking tasks An audio recording is made of the speaking exam after the consent of the test taker (see Article 4, Section (1a) of Government Decree 137/2008), The audio recording should be made in a digital format and in a quality that allows inspection and (re-)assessment, indicating the data and the participants of the examination event. If the recording is not or cannot be made, the examinee has to take the test in front of a three-member Examining Board.

5. Every level of the examination system is standardized with the given CEFR level.

II.11. Present the standardisation procedure conducted in detail (e.g. the description of the familiarisation and training phases, the justification of the procedure(s) selected, the aspects of selecting the judges who take part in the judgment-based procedures and control over their reliability, the description of the decision-making mechanisms, the conditions of the examination(s), the processing of data, the method of analyses, etc.).

The degree of standardization of the examination systems to the CEFR may be different. Concerning the procedures of standardization you can find more information in the publication: Relating Language Examinations to the Common European Framework of Reference for Languages and in the Manual for Relating Language

Attach records of meetings where the levels were harmonized with the CEFR levels and the standards were determined together with illustrative examples about the tasks and sample tasks and also about performance at the local oral and written exams. If needed (see Linking the language examination to the CEFR document) attach documentation regarding external validation including statistical analyses.

Examinations to the Common European Framework of Reference (www.nyak.hu).

6. The examination centre is able to comply with the procedural requirements of the examination efficiently. The examination centre has at least two complete, unused written tests for every examination period. The examination centre regularly collects the opinion of the examiners and the candidates and learns from them.

II.12. Present how the examination system complies with the procedural requirements of the examination. Present how it takes care of permanently used tests. In the case of posterior standardization and correction, describe the process of correction (which tasks, types, subtests and parts of the examination procedure it relates to what

reasons may render it necessary).

II.13. Attach the guidelines/manuals made for the test developers and constructors. II.14. Attach the score sheets to be used at the exam and the records of the exam. II.15. Attach a declaration that the centre has at least two complete, unused written tests for every examination period. II.16. Attach the questionnaire/sample questionnaire used to collect feedback from the candidates/examiners. II.17. Attach a signed and stamped declaration of the acknowledgement of Underlying principles for computer assisted exams. to the accreditation application of the computer-based examination format. the principles in Section D point 3. II.18. In case of applying for both a paper-based and a computer-based format of the same examination system, attach an impact study about the interchangeability of the two formats.

The differentiation of procedural requirements of the examination depends on the types of tasks used and the amount of data treated together. If you use test banks, explain how the content of the ten phases determined as the procedural requirements of the examination are modified.

D. Supplementing a paper-based examination system with a computer-based examination format

1. Please attach a document which details: a. The IT system to be used for the examination;

the technical parameters of the IT system;

the network topology, the client-server architecture and the system operated independently and in hosting

mode;

the software to be used, the most important information concerning the development and use of the

software, the major elements of quality assurance;

the availability of the software to handle the different (languages), levels and types within the accredited

language examination system;

the individual modules of the software used for computer assisted testing (e.g. central task bank module,

central administration module, administration module to be used at the exam sites, test taker’s module);

the capacity of the IT system and its physical and logical limits;

the technical background for storing the tests electronically (test-bank) ;

the system of archiving the tests, the method of guaranteeing traceability for the purpose of viewing,

reviewing and supervision;

b. the structure of eligibility belonging to the various modules (task bank, assigning tests to test takers, assessment module, etc.) of the examination system;

c. the physical (hardware, network) and software safety features of the system; d. the IT disaster recovery plan related to the examination system.

2. Introduce the following points:

Before the exam: a. how the examination centre compile (on paper or using a computer) the test, b. if paper is used where and how the compiled tests are computerized, c. how the examination centre store the tests before and after using them, d. how tests are assigned to test takers, e. how the tests are sent from the central server to the computers used for the exam, f. what data transmission system is used (e.g. network, pen-drive, etc.) g. how the examination centre guarantees the safety of data transmission, h. how the test takers are identified (user names generated in advance or at the exam site, the system of

assigning passwords to test takers, the procedure of assigning access details to personal details).

During the exam event: i. how test takers sign in (start at the same time / possibility of delayed start), j. how identification and other technical problems are handled (technical staff present/the availability of IT

operative, exam organiser and their qualifications),

How the examination centre arranges the following after the exam event:

k. assigning the answers to the tasks; l. in the case of closed tasks the possibility and procedure of computerized scoring; m. in the case of open-ended tasks personal evaluation (only the score is recorded or the assessment of the

assessor is recorded, too);

n. establishing the final score (the possibility of personal check); o. availability (installation, handing over, separate usage);

p. the availability of backup systems (computer and network).

3. Supplement the following points of the Internal Rules for Operation as follows:

VIII./B. In the case of organizing a computer assisted written exam: q. Introduce the independent programme / Adobe Flash application / HTML-based application that can be run on

the local computer. r. When explaining the programme in details, introduce the module, using screenshots, in the light of the

following:

elements of the user interface (description of the picture and function)

o readability (font size, information density, contrast), o handling (mouse, keyboard, touch screen) o navigation (scrolling forward/backward, skip to the task), o the appearance and recording of accents and special characters,

in the case of listening tasks, the possible use of loudspeakers/headphones,

in the case of oral exams the technical background for arranging the video and audio connections,

guaranteeing online assistance throughout the exam,

assisting test takers with disabilities (enlarged task, reading out loud),

the visual separation of recording the tasks and the answers,

the display of the test taker’s identification data permanently somewhere on the screen (displaying the electronic register number),

the display of the time available / remaining for the test taker,

information related to finalizing the test papers.

s. When explaining the procedure concerning the storage of data entered by the test taker, include the following:

whether data is stored on a PC and/or a server

type of storage:

o immediate storage: by pressing a key / by each task / by some other means, e.g. by page, o save initiated by the test taker,

automatic save,

the method of data storage o encrypted data storage, o file compression,

the use of digital imaging,

the procedure of handing over the copy to the test taker in print or in digital form.

t. Please attach the user information booklet of the computer assisted examination system written for test takers, examiners and those responsible for administration.

XIII. Completing the cases of vis major regarding the following: describing the operation of the IT system (what to do in case of possible problems).

4. Attach a signed and stamped Declaration to the request on the acknowledgement of the principles below.

Underlying principles for computer assisted exams.

5. Attach an impact study on the interchangeability of the paper-based and computerized exam format.

To organise a computer assisted exam an accreditation procedure shall be completed in the case of each individual exam site, too. Chapter III of the Accreditation Handbook details what conditions must be met for an exam site where a computerized exam is organized.

E. Making Bilingual Examinations Monolingual In the case of examination systems that were originally accredited as bilingual, the examination centre operating the exam may request the transformation of its system into monolingual or to be able to run a monolingual version of the exam at the same time.

According to the legal provisions in force, the Educational Authority and the Hungarian Accreditation Board for Foreign Language Examinations treats each request to make a bilingual exam monolingual individually. To launch the procedure, the required documents should be submitted to the Educational Authority in 2 printed copies and 2 electronic data carriers in Word and PDF formats, with exactly the same content in both formats. The request can only aim at the necessary changes for making bilingual examinations monolingual (omitting mediation, giving the instructions and prompts in the target language). The changes that are not directly in connection with making a bilingual examination monolingual are considered modification of the examination system. The request has to contain the following documents:

1. Official examination specifications of the monolingual examination system 2. Two sample tests: a bilingual and a monolingual one 3. Guidelines for item writers and examiners in connection with the measurement units / tasks involved in the monolingual

version 4. Sample result sheet and minutes form

E. Modification of the Examination System According to Article 9 Section (1) of the Government Decree 137/2008. (V. 16, ‘ if the language examination centre intends to modify any element of the language exam system, it has to submit a related application to the Authority’. The application for the modification can be submitted in a year’s time after the original accreditation the earliest. The application has to be submitted with detailed justification and supporting documents. The modification of a non-Hungarian language examination system can only be initiated by the non-Hungarian examination provider (the owner of the language examination system) via its Hungarian centre. The application documentation has to be submitted to the Educational Authority in 2 printed copies and on 2 electronic storage media (CD/DVD) in Word and PDF formats with exactly the same content in both formats. The application cannot aim at changes that affect the construct of the examination. The application has to be explained in details, and supporting documents must be submitted. The documents have to contain the following:

1. The list of changes with justifications 2. Updated Official Test Specifications

Furthermore, the following in connection with the affected measurement units:

1. Two new sample tests (oral and/or written); 2. Guidelines for item writers and examiners 3. CEFR standardisation documents 4. Reliability statistics in connection with the sample tests 5. Performance samples 6. Justification of construct stability

Accreditation Procedure: consideration and decision-making After having received the application, the Accreditation Centre for Foreign Language Examinations of the Educational Authority (Authority) examines whether the application is formally compliant and, if necessary, calls upon the applicant to submit the missing documents. If the applicant does not submit the requested missing documents by the set deadline, the Authority, based on Article 31, Section (2) of the Act on the General Rules of Administrative Procedures and Services (Act No. CXL of 2004), terminates the procedure with an injunction. In this case the procedural fee cannot be reimbursed. The formally compliant application is examined content-wise by the Language Examination Accreditation Board (Hungarian abbreviation: NYAT) operating alongside the Authority and by external experts. On the basis of the available data, the Educational Authority makes a decision on the accreditation with a resolution, to be issued within 60 days from the date of the receipt of the formally compliant application.