STANDARDIZED TEST OF BULGARIAN AS A FOREIGN LANGUAGE · 2019. 11. 13. · 3 GENERAL DESCRIPTION OF...
Transcript of STANDARDIZED TEST OF BULGARIAN AS A FOREIGN LANGUAGE · 2019. 11. 13. · 3 GENERAL DESCRIPTION OF...
SOFIA UNIVERSITY ST. KLIMENT OHRIDSKI
DEPARTMENT FOR LANGUAGE TEACHING AND INTERNATIONAL STUDENTS
STANDARDIZED TEST OF BULGARIAN AS A FOREIGN LANGUAGE
EXAMINATION PURPOSE, CONTEXT OF USE, INTENDED POPUPATION AND
GENERAL DESCRIPTION OF THE ASSESSMENT
CORRESPONDENCE BETWEEN CEFR AND ACTFL PROFICIENCY LEVELS
2
PURPOSE OF THE EXAMINATION
The Standardized Test of Bulgarian as a Foreign Language (STBFL) is an examination for
test takers who want to evaluate their general Bulgarian language proficiency in social,
educational, and workplace contexts. The examination provides an assessment of the extent to
which the test takers are able to communicate effectively in everyday situations such as daily
routines, free time activities, traveling, education and career, the environment, cultural and
social life, etc. Listening recordings, reading passages and written task reflect everyday
interactions in a Bulgarian speaking environment.
The examination provides an objective and reliable assessment of the overall language
proficiency in Bulgarian as a foreign in terms of CEFR descriptors of linguistic competences.
The assessment is independent from any syllabus, teaching methodology or textbooks used.
Four language skills (speaking, listening, reading and writing) are tested and assessed. The
exam results are presented as:
• oral exam mark (speaking assessment);
• written exam mark (combining listening, reading and writing assessments);
• final exam mark (combining oral and written exam marks);
• verbal description of examinee’s communication skills in terms of CEFR Can-Do
statements.
CONTEXT OF USE OF THE EXAMINATION The exam is designed to assess the communicative competence in Bulgarian as a foreign
language in the following contexts of use:
• education at Bulgarian high schools and universities
• applying for work
• applying for the Seal of Biliteracy award when graduating from a high school in USA
• certifying the level of language proficiency of the students of Bulgarian schools abroad
• certifying the level of language proficiency of the undergraduate and postgraduate students
at Slavic faculties of foreign universities
• certifying the level of language proficiency of people for business, traveling, cultural
interchange or adopting Bulgarian citizenship.
POPULATION FOR WHICH THE EXAMINATION IS APPROPRIATE The examination is appropriate for the following groups of test-takers:
• students at Bulgarian schools abroad aged 13+
• students at public school in USA applying for Seal of Biliteracy award on their high school
diploma
• undergraduate and postgraduate students at Slavic faculties of foreign universities
• people who like to certify their proficiency in Bulgarian for education, business, traveling
or adopting Bulgarian citizenship.
3
GENERAL DESCRIPTION OF THE ASSESSMENT
• Title of the assessment: Standardized Test in Bulgarian as a Foreign Language
Available examination levels according the Common European Framework of Reference for
languages (CEFR):
• for young learners: A1.1, A1, A2
• for upper secondary, college and university students and adults: A2, B1, B2, C1, C2
• Skills tested
At each examination level (A1, A2, B1, B2, C1, C2) the four language skills (speaking,
listening, reading and writing) are tested independently with equal weights (25%) at the same
competence level.
• Languages for which the assessment is available:
Bulgarian
• When the assessment is given (end of a specific course, end of a language
level, when requested by student, etc.)
The assessment is given by the request of individual test-takers (individual examination) or by
the request of a school, college, university or authorized testing center (group examination).
• Description of how the scoring rubrics equate to the proficiency sub-levels and the method used to equate the scores:
First, the cut-off score for scoring rubrics is set by a panel of experts using the Angoff
method.
Second, the mean of the test scores for these rubrics is calculated.
Third, the segment from cut-off and maximum test score is divided into four approximately
equal sub-segments, corresponding to satisfactory, good, very good and excellent proficiency
sub-levels within the testing CEFR level. The mean of the test scores is within or very close to
the segment, associated with good proficiency sub-level .
• Minimum score used to equate to intermediate-mid proficiency:
For B1 level test the cut-off score is 60% and the minimum score for intermediate (good) sub-
level is 41 points or 72% out of 57 (the maximum test score).
For B2 level test the cut-off score is 60% and the minimum score for intermediate (good) sub-
level is 56 points or 70% out of 80 (the maximum test score).
4
• Description of the scoring process, including: • Who scores the assessments • What training is provided • What checks and balances are used to ensure inter-rater reliability
The reproductive skills (listening and reading) are computer scored by the examination
platform based on Moodle 3.5 release.
The productive skills (speaking and writing) are scored by certified raters, approved by the
examination board under rigorous rater certification procedure.
The raters training includes familiarization with CEFR Can-Do descriptors for language usage
and CERF descriptors for communicative competences, taking part in standard setting
procedures and benchmarking of samples of oral and written production.
Two rater reliability procedures were carried out in 2013 and 2015 to assess the inter-rater
reliability by calculating Cohen’s Kappa for pairs of raters and intraclass correlation (ICC) for
intra-raters agreement between different groups of raters.
DETAILED DESCRIPTION OF THE ASSESSMENT AT B1 AND B2 LEVELS OF CEFR B1 Level Assessment
Oral exam (Speaking)
Parts Tasks Maximum
score (points)
Candidate’s
scores
Part1 Interview 12
Part 2 Spontaneous communication 15
Part 3 Monologue 15
Part 4 Comment on a picture 15
Total 57 points
Minimum Pass Score 34 points 60% of the maximum
score
Converting Raw Scores Into Grades
Raw score (points)
0 - 33 34 – 40 41 – 46 47 - 53 54 - 57
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
5
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points.
Written Exam Written exam consists of 3 divisions – Listening, Reading and Writing,
whish are assessed independently.
Assessment Skill
Parts Maximum points
Candidate’s scores
Listening Global and detail listening comprehension, spontaneous communication
Part 1 15
Part 2 15
Part 3 15
Part 4 12
Total Minimum pass score
57 34
60% of the
maximum score
Converting Raw Scores Into Grades
Raw score (points)
0 - 33 34 – 40 41 – 46 47 - 53 54 - 57
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
Into each raw score interval the grade is calculated proportionally to candidate’s raw score points.
Assessment Skill Parts Maximum points
Candidate’s scores
Reading: Global and detail reading comprehension, Vocabulary and Grammar
Part 1 15
Part 2 15
Part 3 12
Part 4 15
Total Minimum pass score
57 34
60% of the maximum
score
Converting Raw Scores Into Grades
Raw score (points)
0 - 33 34 – 40 41 – 46 47 - 53 54 - 57
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points.
6
Assessment Skill
Parts Maximum points
Candidate’s scores
Writing (Essay writing)
Part 1 25
Part 2 32
Total Minimum pass score
57 34
60% of the maximum
score
Converting Raw Scores Into Grades
Raw score (points)
0 - 33 34 – 40 41 – 46 47 - 53 54 - 57
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points.
Final Examination Grades
Grade Numeric Verbal
Oral Exam Grade
Written Exam Grade (average of the Listening, Reading and Writing grades)
FINAL EXAM GRADE 0.25 х (Oral Exam Grade) + 0.75 х (Written Exam Grade)
The officially accepted system of assessment in the Republic of Bulgaria is the six-grade scale with the highest grade “Excellent 6” and the lowest pass grade
“Satisfactory 3”. Correspondence between Verbal and Numeric grades:
Numeric Verbal
2.00 – 2.99 Fail
3.00 – 3.49 Satisfactory
3.50 – 4.46 Good
4.50 – 5.49 Very Good
5.50 – 6.00 Excellent
7
B2 Level Assessment
Oral exam (Speaking)
Parts Tasks Maximum
score (points)
Candidate’s
scores
Part1 Interview 20
Part 2 Spontaneous communication 20
Part 3 Monologue 20
Part 4 Comment on a picture 20
Total 80 points
Minimum Pass Score 48 points 60% of the maximum
score
Converting Raw Scores Into Grades
Raw score (points)
0 - 47 48 – 55 56 – 64 65 - 73 74 - 80
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points. Written Exam
Written exam consists of 3 divisions – Listening, Reading and Writing,
whish are assessed independently.
Assessment Skill
Parts Maximum points
Candidate’s scores
Listening Global and detail listening comprehension, spontaneous communication
Part 1 10
Part 2 10
Part 3 20
Part 4 20
Part 5 20
Total Minimum pass score
80 48
60% of the maximum
score
8
Converting Raw Scores Into Grades
Raw score (points)
0 - 47 48 – 55 56 – 64 65 - 73 74 - 80
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points.
Assessment Skill Parts Maximum points
Candidate’s scores
Reading: Global and detail reading comprehension, Vocabulary and Grammar
Part 1 24
Part 2 10
Part 3 10
Part 4 10
Part 5 26
Total Minimum pass score
80 48
60% of the maximum
score
Converting Raw Scores Into Grades
Raw score (points)
0 - 47 48 – 55 56 – 64 65 - 73 74 - 80
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points.
Assessment Skill
Parts Maximum points
Candidate’s scores
Writing (Essay writing)
Part 1 40
Part 2 40
Total Minimum pass score
80 48
60% of the maximum
score
Converting Raw Scores Into Grades
Raw score (points)
0 - 47 48 – 55 56 – 64 65 - 73 74 - 80
Grade Fail (2)
Satisfactory (3 – 3.49)
Good (3.50 – 4.49)
Very Good (4.50 – 5.49)
Excellent (5.50 - 6)
9
Into each raw score interval the grade is calculated proportionally to candidate’s
raw score points.
Final Examination Grades
Grade Numeric Verbal
Oral Exam Grade
Written Exam Grade (average of the Listening, Reading and Writing grades)
FINAL EXAM GRADE 0.25 х (Oral Exam Grade) + 0.75 х (Written Exam Grade)
The officially accepted system of assessment in the Republic of Bulgaria is the
six-grade scale with the highest grade “Excellent 6” and the lowest pass grade “Satisfactory 3”. Correspondence between Verbal and Numeric grades:
Numeric Verbal
2.00 – 2.99 Fail
3.00 – 3.49 Satisfactory
3.50 – 4.46 Good
4.50 – 5.49 Very Good
5.50 – 6.00 Excellent
CORRESPONDENCE BETWEEN CEFR AND ACTFL PROFICIENCY LEVELS
The Common European Framework of Reference for Languages abbreviated as CEFR, is a
guideline used to describe levels of proficiency in a foreign language. It was developed by the
Council of Europe and it is widely used in language teaching and assessment across Europe.
This framework, also known as CEFR levels, can be used to refer to all languages.
In this framework there are 6 levels going from beginner to near-native. Below are the short
description of the levels.
CEFR LEVELS DESCRIPTION
A1
BEGINNER
• Can understand and use familiar concrete everyday expressions and
very basic phrases.
• Can introduce him/herself and others and can ask and answer
questions about personal details such as where he/she lives, people
he/she knows and things he/she has.
• Can interact in a simple way provided the other person talks slowly
10
and clearly and is prepared to help.
• Main grammar points to know: common adjectives & adverbs of
frequency, going to, how much/how many, imperatives, I’d like, ‘s
– possessive, common prepositions of place and time, present
simple & continuous, there is/are
A2
ELEMENTARY
• Can understand sentences and frequently used expressions (e.g.
very basic personal and family information, shopping, local
geography, employment).
• Can communicate in simple and routine tasks and exchange
information on familiar and routine matters.
• Can describe in simple terms aspects of his/her background,
immediate environment and matters in areas of immediate need.
• Main grammar points to know: countable/uncountable nouns,
adverbs of frequency, future will/going to, much/many, present
perfect, past simple, past continuous, common phrasal verbs,
common modals: can/should
B1
INTERMEDIATE
• Can understand the main points of clear standard input on familiar
matters regularly encountered in work, school, leisure, etc.
• Can deal with most situations while traveling in an area where the
language is spoken.
• Can produce simple connected text on topics that are familiar or of
interest.
• Can describe experiences and events, dreams, hopes and ambitions
and briefly give reasons and explanations for opinions and plans.
• Main grammar points to know: question tags, intensifiers:
too/enough, future tenses, past tenses, modals, conditionals, wh-
questions in the past.
11
B2
UPPER-
INTERMEDIATE
• Can understand the main ideas of complex text on both concrete
and abstract topics, including technical discussions in his/her field
of specialization.
• Can interact with fluency and spontaneity that makes regular
interaction with native speakers quite possible without strain for
either party.
• Can produce clear, detailed text on a wide range of subjects and
explain a viewpoint on a topical issue giving the advantages and
disadvantages of various options.
• Main grammar points to know: perfect tenses, mixed conditionals,
modals in the present, phrasal verbs, reported speech, wish, relative
clauses
C1
ADVANCED
• Can understand a wide range of demanding, longer texts.
• Can express ideas fluently and spontaneously without much
obvious searching for expressions.
• Can use language flexibly and effectively for social, academic and
professional purposes.
• Can produce clear, well-structured, detailed text on complex
subjects, showing controlled use of organizational patterns,
connectors and cohesive devices.
• Main grammar points to know: inversion, mixed conditionals,
modals in the past, all passive forms, phrasal verbs (all patterns),
wish/if only for regrets
C2
PROFICIENT
(NEAR-NATIVE)
• Can understand with ease virtually everything heard or read.
• Can summarize information from different spoken and written
sources, reconstructing arguments and accounts in a coherent
presentation.
• Can express him/herself spontaneously, very fluently and precisely,
differentiating finer shades of meaning even in the most complex
situations.
See the official correspondence between CEFR and ACTFL levels on the next page.
12
13
INTERPRETATION OF THE EXAMINATION RESULTS
CERF A1 LEVEL ASSESSMENT
The four language skills (speaking, listening, reading and writing) are tested independently
with equal weights (25%) at the same competence level A1.
The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally
acceptable competence” for this skill at the level being tested, e.g. A1.
The other exam grades indicate the following: the higher the exam grade the more competent
is the candidate within the tested level, e.g. A1.
According to ACTFL competence scale the exam results may be interpreted depending on the
exam grade as follows:
grade band 3.00 – 4.49 grade band 4.50 – 6.00
receptive skills (listening and reading)
NOVICE HIGH INTERMEDIATE LOW
productive skills (speaking and writing)
NOVICE HIGH NOVICE HIGH
CERF A2 LEVEL ASSESSMENT
The four language skills (speaking, listening, reading and writing) are tested independently
with equal weights (25%) at the same competence level A2.
The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally
acceptable competence” for this skill at the level being tested, e.g. A2.
The other exam grades indicate the following: the higher the exam grade the more competent
is the candidate within the tested level, e.g. A2.
CEFR competence scale does not distinguish in rating between receptive and productive
skills.
According to ACTFL competence scale the exam results may be interpreted depending on the
exam grade as follows:
grade band 3.00 – 4.49 grade band 4.50 – 6.00
receptive skills (listening and reading)
INTERMEDIATE MID INTERMEDIATE MID
productive skills (speaking and writing)
INTERMEDIATE LOW INTERMEDIATE LOW
14
CERF B1 LEVEL ASSESSMENT
The four language skills (speaking, listening, reading and writing) are tested independently
with equal weights (25%) at the same competence level B1.
The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally
acceptable competence” for this skill at the level being tested, e.g. B1.
The other exam grades indicate the following: the higher the exam grade the more competent
is the candidate within the tested level, e.g. B1.
CEFR competence scale does not distinguish in rating between receptive and productive
skills.
According to ACTFL competence scale the exam results may be interpreted depending on the
exam grade as follows:
grade band 3.00 – 4.49 grade band 4.50 – 6.00
receptive skills (listening and reading)
INTERMEDIATE HIGH ADVANCED LAW
productive skills (speaking and writing)
INTERMEDIATE MID INTERMEDIATE HIGH
CERF B2 LEVEL ASSESSMENT
The four language skills (speaking, listening, reading and writing) are tested independently
with equal weights (25%) at the same competence level B2.
The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally
acceptable competence” for this skill at the level being tested, e.g. B2.
The other exam grades indicate the following: the higher the exam grade the more competent
is the candidate within the tested level, e.g. B2.
CEFR competence scale does not distinguish in rating between receptive and productive
skills.
According to ACTFL competence scale the exam results may be interpreted depending on the
exam grade as follows:
grade band 3.00 – 4.49 grade band 4.50 – 6.00
receptive skills (listening and reading)
ADVANCED MID ADVANCED MID
productive skills (speaking and writing)
ADVANCED LOW ADVANCE MID
15
CERF C1 LEVEL ASSESSMENT
The four language skills (speaking, listening, reading and writing) are tested independently
with equal weights (25%) at the same competence level C1.
The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally
acceptable competence” for this skill at the level being tested, e.g. C1.
The other exam grades indicate the following: the higher the exam grade the more competent
is the candidate within the tested level, e.g. C1.
CEFR competence scale does not distinguish in rating between receptive and productive
skills.
According to ACTFL competence scale the exam results may be interpreted depending on the
exam grade as follows:
grade band 3.00 – 4.49 grade band 4.50 – 6.00
receptive skills (listening and reading)
ADVANCED HIGH SUPERIOR
productive skills (speaking and writing)
ADVANCED HIGH ADVANCE HIGH
CERF C2 LEVEL ASSESSMENT
The four language skills (speaking, listening, reading and writing) are tested independently
with equal weights (25%) at the same competence level C2.
The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally
acceptable competence” for this skill at the level being tested, e.g. C2.
The other exam grades indicate the following: the higher the exam grade the more competent
is the candidate within the tested level, e.g. C2.
CEFR competence scale does not distinguish in rating between receptive and productive
skills.
According to ACTFL competence scale the exam results may be interpreted depending on the
exam grade as follows:
grade band 3.00 – 4.49 grade band 4.50 – 6.00
receptive skills (listening and reading)
DISTINGUISHED DISTINGUISHED
productive skills (speaking and writing)
SUPERIOR SUPERIOR
16
SAMPLE CERTIFICATE
MATERIALS DEVELOPED BY:
D-r Mardik Andonyan
Test Administrator
Dept. for Language Teaching & International Students
Sofia University