ESOL International English Speaking Examination Level B2 ...
The B2 level and its applicability in university entrance...
Transcript of The B2 level and its applicability in university entrance...
![Page 1: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/1.jpg)
The B2 level and its applicability in university entrance tests
Cecilie Hamnes Carlsen – VOX Bart Deygers – CLE (KULeuven)
![Page 2: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/2.jpg)
Contents
Background: LAP & B2
Data: Norwegian study Belgian study
Main Iindings
![Page 3: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/3.jpg)
The blurry construct of LAP Language for academic purposes
Consensus: No consensus: § Argumentative skills § Summarizing skills § Integrated skills § Context and content-‐heavy
(Cummins, 1979; Schleppegrell, 2001; Bailey & Heritage, 2008; Davies, 2008; Misley & Yin, 2009; Braine, 2011; Cho & Bridgeman, 2012; Donohue & Erling, 2012, Weigle, 2013; Cumming, 2013; Sawaki, 2013)
§ Skills & level § Context of use § Role of cognition § Users
![Page 4: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/4.jpg)
About that level In Europe: § Language is often a prerequisite for university admission
§ B2 is the most common level
§ But there is no uniform policy
![Page 5: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/5.jpg)
And about that skill set What makes a test into an LAP test? Probably: Giving presentations Including graphs & tables Understanding lectures Summarizing texts Building argumentation
(Lynch, 2001; Hyland & Hamp-‐Lyons, 2002; Davies, 2008; Cho & Bridgeman, 2012)
![Page 6: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/6.jpg)
And about that context What does LAP refer to? All language used: in teaching in academic teaching in science in acquiring new knowledge …
(Chamot and O’Malley, 1994; Schleppegrell, 2001; Bailey & Heritage, 2008)
![Page 7: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/7.jpg)
Challenges
#1 Is B2 appropriate as the threshold level for university entrance?
#2 What language skills should be part of a university entrance test?
#3 What is the appropriate context to focus on?
![Page 8: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/8.jpg)
Introducing two studies
Norwegian study Belgian study
RQ What proIiciency level is sufIicient to succeed at university?
Which linguistic skills are expected on day 1?
Context of use University, throughout university studies
University, day 1
Method
Quantitative: Self-‐reporting & entrance test score
Qualitative: Focus groups
Population L2 students (N = 449) Academic teaching staff (N = 24)
![Page 9: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/9.jpg)
The Norwegian study
Context Different locally developed university entrance tests One national standardized test (CEFR-‐linked; contains writing, reading & listening) (Test i norsk – høyere nivå, “Bergenstesten”)
Main focus What proIiciency level is sufIicient to succeed at university?
![Page 10: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/10.jpg)
The Norwegian study
25
93 86 121
68 56
Requirement for university entrance
B2
![Page 11: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/11.jpg)
The Norwegian study Questions about sub skills Listening to lectures Reading curriculum literature Writing tasks & exam papers Speaking in a group
Questions about academic success All questions combined into one factor
![Page 12: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/12.jpg)
The Norwegian study: results Score at university entrance-‐test & sub skills Listening
0 %
10 %
20 %
30 %
40 %
50 %
60 %
70 %
80 %
450 p 500 p 550 p 600 p 650 p 700 p
svært lettlettmiddels lettvanskeligsvært vanskelig
Very easy
Easy
Very dif8icult
Dif8icult Quite easy
B2
Gamma 0,264, p < 0.05 (0.00)
![Page 13: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/13.jpg)
The Norwegian study: results Score at university entrance-‐test & sub skills Listening
Gamma 0,264, p < 0.05 (0.00)
0 %
10 %
20 %
30 %
40 %
50 %
60 %
70 %
80 %
450 p 500 p 550 p 600 p 650 p 700 p
svært lettlettmiddels lettvanskeligsvært vanskelig
Very easy
Easy
Very dif8icult
Dif8icult Quite easy
B2
![Page 14: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/14.jpg)
0 %
10 %
20 %
30 %
40 %
50 %
60 %
450 p 500 p 550 p 600 p 650 p 700 p
svært lettlettmiddels lettvanskeligsvært vanskelig
The Norwegian study: results Score at university entrance-‐test & sub skills Reading
Very easy
Easy
Very dif8icult
Dif8icult Quite easy
Gamma 0,307, p <0.05 (0.00)
![Page 15: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/15.jpg)
0 %
10 %
20 %
30 %
40 %
50 %
60 %
70 %
450 p 500 p 550 p 600 p 650 p 700 p
svært lettlettmiddels lettvanskeligsvært vanskelig
The Norwegian study: results Score at university entrance-‐test & sub skills Writing
Very easy Easy
Very dif8icult
Dif8icult Quite easy
Gamma: 0,227, p <0.05 (0.00)
![Page 16: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/16.jpg)
0 %
10 %
20 %
30 %
40 %
50 %
60 %
70 %
450 p 500 p 550 p 600 p 650 p 700 p
svært godtgodtmiddelsdårligsvært dårlig
The Norwegian study: results Score at university entrance-‐test & sub skills Speaking
Very easy Easy
Dif8icult Quite easy
Gamma 0,271, p <0.05 (0.00)
Very dif8icult
![Page 17: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/17.jpg)
The Norwegian study - results
Score at university entrance-‐test & academic success
High degree of academic success Low degree of academic success
![Page 18: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/18.jpg)
The Norwegian study - results
Main Iindings Scores at LAP-‐test correlate positively and signiIicantly with academic success B2 level is the minimum necessary to succeed
But is it enough?
![Page 19: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/19.jpg)
The Belgian study
24 professors in 6 mixed focus groups (Jan & Feb 2014) § Which skills are required on day 1? § What proIiciency level is expected on day 1? § Methods:
§ Bookmarking § Individual judgment & group Consensus
(17 interviews with L2 students October – December 2012)
![Page 20: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/20.jpg)
Central concept: day 1
What do we cognitively & linguistically expect of our students on day 1?
Should our expectations for L2 students differ? No
![Page 21: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/21.jpg)
Receptive skills rule
Reading Listening Writing Speaking
First and foremost, students entering university should be able to store information
(Sociology)
This says a lot about our expectations. The active skills are below and the passive ones are on top.
(Geology)
“
![Page 22: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/22.jpg)
Expected reading on day 1
C2 C1 B2 B1
★★
★★★★★
★★★★★★★★
★
★ ★★★★★
★★
From day 1, students should be able to work with all these texts. It’ll take them some effort, but it’s doable.
(Educational affairs)
“
![Page 23: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/23.jpg)
Expected listening on day 1
C2 C2 C1 B2
★★★★★★
★★
★★★★★★★★★ ★ ★★★★★★
Nobody teaches like [B2 & C1] (Chemistry)
This is primary school talk
(Philosophy)
“
![Page 24: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/24.jpg)
Expected writing on day 1
C2(L1) C1(L1) B2 B1
Psych: [B2 & B1 samples] are unacceptable, even if they are L2 students Policy: But you still read this stuff in master students’ papers? Psych.: All the time! Even after 5 years at university
“ ★★★
★★★★
★
★★ ★★★★★
★★
![Page 25: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/25.jpg)
Who cares about speaking anyway?
Law: Basically, no faculty has any real demands when it comes to speaking
Eng.: True. Maybe we can lower the expected level then.
Law: It can be below [B2] Eng.: Or maybe just slightly above? Lang.: Do we need to test it at all? Eng.: Yeah. You’re right.
“ Expected speaking on day 1
![Page 26: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/26.jpg)
Subskills on day 1 (domain experts)
Must-‐have • Take class notes • Understand text structure • Write accessibly / meaningfully Mustn’t-‐have • Describe graphs & tables • Give a presentation • Summarize multiple sources • Understand implicit message
![Page 27: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/27.jpg)
About those subskills
First: -‐ It’s all about structure -‐ Meaning > correctness
But: -‐ How about graphs & tables? -‐ How about presentations?
![Page 28: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/28.jpg)
Main findings: B2
Is B2 appropriate as the threshold level for university entrance? Norway: anything below B2 is insufIicient
Belgium: for receptive skills B2 is insufIicient on day 1
=> Differentiated proIiles
![Page 29: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/29.jpg)
Main findings: Skills
What language skills should be part of a university entrance test? Norway: Listening & writing cause most problems during study
Belgium: Receptive skills, structure, and getting meaning across matter most on day 1
=> Depends on focus
![Page 30: The B2 level and its applicability in university entrance testsevents.cambridgeenglish.org/alte-2014/docs/presentations/... · 2014-07-03 · The B2 level and its applicability in](https://reader033.fdocuments.us/reader033/viewer/2022042012/5e72b78bad30061e5c591cc5/html5/thumbnails/30.jpg)
Main findings: Test focus
What is the appropriate context to focus on?
=> Fairness: is it fair for L2 university entrance tests to include skills we don’t expect of L1s?
The importance of a level playing Iield And of playing the same game