Standard-referenced assessment of productive L2-skills of Swiss pupils
14
Sandra Hutterli/Ruth Keller EALTA Conference 2005 Standard-referenced assessment of productive L2-skills of Swiss pupils
description
Standard-referenced assessment of productive L2-skills of Swiss pupils. Contents of the talk: Background information Evaluation of writing ability in English Evaluation of speaking ability in French Further stages of the project. Background-information. Status quo of the project. - PowerPoint PPT Presentation
Transcript of Standard-referenced assessment of productive L2-skills of Swiss pupils
Sandra Hutterli/Ruth KellerEALTA Conference 2005
Standard-referenced assessment of productive L2-skills of Swiss pupils
Sandra Hutterli/Ruth KellerEALTA Conference 2005
Contents of the talk:
1. Background information
2. Evaluation of writing ability in English
3. Evaluation of speaking ability in French
4. Further stages of the project
Sandra Hutterli/Ruth KellerEALTA Conference 2005
1. Background information
1998: New concept on language policy for
SwitzerlandDefinition of learning targets: based of the levels of the
CEF Canton of Zurich: L2-competence at the end
of compulsory school years A2 to B1+
Focus of the project: standard-referenced assessment of
productive L2-skills
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
2. Status quo of the project
Basis: Scales and descriptors of the IEF-project
1st step: task design, feedback from teachers
2nd step: pre-test, feedback regarding tasks from test takers
3rd step: standard-referenced assessment of texts
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
3. Assessment of writing ability in English
Task design
Basis: action-oriented, communicative approach
Writing ability: 'writing as an end in itself'
Scales: - action-orientedness- organisation and structure- grammar- vocabulary- orthography
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
3. Assessment of writing ability in English
Tasks• in written form• in German
• Aspects included: - short context description- actual assignments- organisational details
• Topics: - Letter: Tell someone how you live- Description: A typical school day- Email: Thank someone for entertaining
you- Story: ‘The worst day I ever had’
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
3. Assessment of writing ability in English
Results of the pre-test
- Manageable tasks- Standard referenced assessment is possible- Discrimination between different competence
levels
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
4. Assessment of speaking ability in French
Task designspeaking: communicative, action-oriented approach
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
dialogical monological
transaction1 buy a train ticket in order to go to a concert during a stay
formal presentation of oneself in order to be recognized by another person
interpersonal and creative usage1
description of oneself as a member of the class to a foreign partner class
problem solving1 make an appointment with a friend and discussion about what they will do
1 cf. Schneider and North (2000, 36)
Sandra Hutterli/Ruth KellerEALTA Conference 2005
4. Assessment of speaking ability in French
Task design
tasks: written form, German
short context description
actual assignments
organisational details
scales: action-orientedness
communication/interaction
pronunciation
fluidity
vocabulary
grammar
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
4. Assessment of speaking ability in French
Pre-test
preparation: 5 minutes, notes
performance: without notes, video
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
4. Assessment of speaking ability in French
Results of the pre-test
- wide range of learner‘s results within the same test
- comprehensible tasks
- different estimation of the task‘s realistic aspect (teachers and learners)
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
5. Future stages of the project
Rater training and integration in teacher education2
1. Illustration: levels of CEF and descriptors of IEF (2-3 standardised oral and written performances)
2. Practice: assessment training (about 3 samples)
3. Individual assessment: (rate the rest of the performances)
2 cf. Relating language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEF), Strasbourg: 2003
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
5. Future stages of the project
Development in the field of standard-oriented assessment in Switzerland
HarmoS project:
Harmonization of the compulsory education in Switzerland
Binding standards for foreign language learners at the end of compulsory school years
Assessment of learner‘s language level at the main points of transition (primary - secondary/sec I - sec II)
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
Sandra Hutterli/Ruth KellerEALTA Conference 2005
Many thanks for your attention.
1. Background-information
2. Status quo of the project
4. Assessment of speaking ability in French
- Design
- Pre-Test
- Results
5. Future stages of the project
- Rater training
- Switzerland
3. Assessment of writing ability in English
- Design
- Tasks
- Results
