Www.che.de Uwe Brandenburg Options and limits of measurability: the experience from the Excellence...
-
Upload
conrad-neal -
Category
Documents
-
view
213 -
download
0
Transcript of Www.che.de Uwe Brandenburg Options and limits of measurability: the experience from the Excellence...
www.che.de
Uwe Brandenburg
Options and limits of measurability: the experience from the Excellence
Ranking in the light of the global ranking discussion
Aims and Target GroupsAims and Target Groups
MethodologyMethodology
FindingsFindings
ExcellenceRanking:ExcellenceRanking:
Agenda
Options and Limits of measurability:Options and Limits of measurability:
MethodologyMethodology
FindingsFindings
CHE Method and Typical Issues with global rankings
CHE Method and Typical Issues with global rankings
2Options and limits of measurability | Uwe Brandenburg |
Limits of measurability
Not everything that can be counted, counts.
Not everything that counts can be counted.
Albert Einstein
3Options and limits of measurability | Uwe Brandenburg |
individual ranks inleague tables
Rank groups top intermediate bottom
overall score fromweighted indicators
ranking of wholeuniversities
Multidimensionalranking
Ranking of single subjects /
subject areas
What we NOT do! What we do!
CHE Method and Typical Issues with global rankings
4Options and limits of measurability | Uwe Brandenburg |
Aims of the CHE Excellence Ranking ProjectAims of the CHE Excellence Ranking Project
First and foremost: to provide information for undergraduate students concerning master‘s and PhD
programmes in Europe
First and foremost: to provide information for undergraduate students concerning master‘s and PhD
programmes in Europe
Support for the idea of the European Higher Education Area (EHEA)
Support for the idea of the European Higher Education Area (EHEA)
Show the strength of European researchShow the strength of European research
Help participating HEIs to improve upon their programmes or services through comparison
Help participating HEIs to improve upon their programmes or services through comparison
ExcellenceRanking – Aims
5Options and limits of measurability | Uwe Brandenburg |
Undergraduates from European and non-European universitiesUndergraduates from European and non-European universities
Higher Education Institutions (HEIs)Higher Education Institutions (HEIs)
Organisations and Society at large Organisations and Society at large
ExcellenceRanking – Target Groups
Target GroupsTarget Groups
6Options and limits of measurability | Uwe Brandenburg |
ExcellenceRanking – Subjects and Type of HEI
Only universities with the right to award a Ph.D.Only universities with the right to award a Ph.D.
Round I
Round II
7Options and limits of measurability | Uwe Brandenburg |
Two step process: First step - analysis of all European HEIs based on certain indicators
Natural Sciences 2007 Social Sciences 2009 Natural Sciences 2010
Number of publications in the web of sciences (1997-2004)
Number of publications in the web of sciences (1999-2006)
Number of publications in the web of sciences (2001-2008)
Citations (normalised to the international standard)
Citations (normalised to the international standard)
Citations (normalised to the international standard)
Highly Cited Authors, Nobel Prize winners, field medalists
Book Citations Number of projects in the Marie Curie programme
Number of projects in the Marie Curie programme
Student/ Teaching Staff Mobility
Student/ Teaching Staff Mobility
Erasmus Mundus Master Erasmus Mundus Master
Nobel Prize winners, Fields Medalists, Körber European Science Award winners
ExcellenceRanking: Methodology 2 – Overview of Indicators
8Options and limits of measurability | Uwe Brandenburg |
ExcellenceRanking: Findings 1 – Overview
Very important: non-ranked data and informationVery important: non-ranked data and information
Considerable amount of supplemental information (on departments, work conditions, stipends etc.)
Considerable amount of supplemental information (on departments, work conditions, stipends etc.)
Central feature of online version: access to more than 2,000 research groups assigned to different research categories
Central feature of online version: access to more than 2,000 research groups assigned to different research categories
9Options and limits of measurability | Uwe Brandenburg |
Between 117 (physics) and 129 (mathematics) HEIs
with at least one top group (silver or gold) placement in
one of the four indicators
Between 117 (physics) and 129 (mathematics) HEIs
with at least one top group (silver or gold) placement in
one of the four indicators
Distribution is rather comparable between the subjects; in general only around 5% of the overall group qualify in all four
indicators
Distribution is rather comparable between the subjects; in general only around 5% of the overall group qualify in all four
indicators
Decrease in numbers per additional indicator: app.
45-50%
Decrease in numbers per additional indicator: app.
45-50%Gold or silver medals:
● four ● three ● two ● one
PhysikMathematikChemieBiologie
100%
75%
50%
25%
0%
80% !
ExcellenceRanking: Findings 2 – Natural Sciences 2007
10Options and limits of measurability | Uwe Brandenburg |
177 HEIs have at least one top group placement in one of the indicators in the field of Economics, 148 in Psychology and
125 in Politics
177 HEIs have at least one top group placement in one of the indicators in the field of Economics, 148 in Psychology and
125 in Politics
69 HEIs are in the excellence group in the field of Economics, 59 in
Psychology and 51 in Politics
69 HEIs are in the excellence group in the field of Economics, 59 in
Psychology and 51 in Politics
Example Politics: No HEI has top group placements in all 6 core indicators; just one HEI has top group placements in 5 core indicators, 2 HEIs in 4, 16 HEIs in 3 und 32 HEIs in 2 indicators respectively
ExcellenceRanking: Findings 3 – Social Sciences 2009
11Options and limits of measurability | Uwe Brandenburg |
7/1
14/3
17/7
287/23
12/3
4
24/3
9/1
42/6 5
8
37/6
Black 1 or 2 top group placementsRed 3 or 4 top group placements
20/13
4/1
6
1
16/8
Top group placements throughout Europe
1
85/24
ExcellenceRanking: Findings 9 – Natural Sciences 2007 – entire sample
12Options and limits of measurability | Uwe Brandenburg |
2
22
17
1262
8
29
10
20 5
6
17
57
3
3
2
22
Top group placements across Europe
151
2
ExcellenceRanking: Findings 10 – Social Sciences 2009 – entire sample
13Options and limits of measurability | Uwe Brandenburg |
OverallOverall
Less than 60 HEIs in the three and four top group segmentLess than 60 HEIs in the three and four top group segment
Biology 25, chemistry 25, physics 24, mathematics 19Biology 25, chemistry 25, physics 24, mathematics 19
app. 1.3% of all ERASMUS eligible HEIs in Europe (ca. 4,900)app. 1.3% of all ERASMUS eligible HEIs in Europe (ca. 4,900)
Most HEIs excel in one subject (33), 15 in two, 4 in three and 4 in all four subject areas
Most HEIs excel in one subject (33), 15 in two, 4 in three and 4 in all four subject areas
Not all institutions answered the questionnaires (mainly UK universities did not answer)
Not all institutions answered the questionnaires (mainly UK universities did not answer)
ExcellenceRanking: Findings 13 – Natural Sciences 2007 – Overview
14Options and limits of measurability | Uwe Brandenburg |
OverallOverall
Less than 70 HEIs have top group placements in at least 3 core indicators
Less than 70 HEIs have top group placements in at least 3 core indicators
Economics 27, Politics 19, Psychology 20Economics 27, Politics 19, Psychology 20
Most HEIs excel in one subject (71), 28 in two and 18 in three subjects
Most HEIs excel in one subject (71), 28 in two and 18 in three subjects
app. 1.3% of all ERASMUS eligible HEIs in Europe (ca. 4,900)app. 1.3% of all ERASMUS eligible HEIs in Europe (ca. 4,900)
Not all institutions answered the questionnaires (mainly UK universities did not answer)
Not all institutions answered the questionnaires (mainly UK universities did not answer)
ExcellenceRanking: Findings 14 – Social Sciences 2009 – Overview
15Options and limits of measurability | Uwe Brandenburg |
ExcellenceRanking - Outlook to the future
The first round for Natural Sciences was considered tentative; methodology has been adapted and is revised constantly
The first round for Natural Sciences was considered tentative; methodology has been adapted and is revised constantly
Both goals, supporting the EHEA and quenching the thirst for „discovering the best“ remains but always:
Both goals, supporting the EHEA and quenching the thirst for „discovering the best“ remains but always:
Reflection of the methodological stipulations
and boundaries of rankings!
Reflection of the methodological stipulations
and boundaries of rankings!
Third round (again Natural Sciences) is running; findings will be published in October 2010
Third round (again Natural Sciences) is running; findings will be published in October 2010
The findings of the second round for Social Sciences were published in October 2009
The findings of the second round for Social Sciences were published in October 2009
16Options and limits of measurability | Uwe Brandenburg |
ExcellenceRanking - Engineering
Many talks over 2 years with major Engineering AssociationsMany talks over 2 years with major Engineering Associations
Thus engineering ranking was decided not to be made at that stage
Thus engineering ranking was decided not to be made at that stage
Indicators for which data are available are not relevant to the HEIsIndicators for which data are available are not relevant to the HEIs
Indicators considered relevant by the Engineers not publicly fully available
Indicators considered relevant by the Engineers not publicly fully available
17Options and limits of measurability | Uwe Brandenburg |
New approach in U MultirankNew approach in U Multirank
ExcellenceRanking – Hungarian HEIs
Very few Hungarian HEIs featured in ER I and IIVery few Hungarian HEIs featured in ER I and II
Strengths: mobility and Erasmus Mundus (Corvinus made it into the Excellence Group in Economics through
mobility/int. indicators)
Strengths: mobility and Erasmus Mundus (Corvinus made it into the Excellence Group in Economics through
mobility/int. indicators)
Greatest weakness: international visibility of researchGreatest weakness: international visibility of research
Data for ER III is not public yet but result comparable to former rounds
Data for ER III is not public yet but result comparable to former rounds
18Options and limits of measurability | Uwe Brandenburg |
ExcellenceRanking – Hungarian HEIs
19Options and limits of measurability | Uwe Brandenburg |
ELTEELTE
ExcellenceRanking – Hungarian HEIs
But: this does not say ANYTHING about the general quality in Hungarian HEIs as the ER is methodologically focused:
•English focus
•Target group
•Subject areas
But: this does not say ANYTHING about the general quality in Hungarian HEIs as the ER is methodologically focused:
•English focus
•Target group
•Subject areas
20Options and limits of measurability | Uwe Brandenburg |
ExcellenceRanking – Hungarian HEIs
Top group placements in the actual ranking 2009Top group placements in the actual ranking 2009
21Options and limits of measurability | Uwe Brandenburg |
Corvinus Egyetem University:
•TS mobility•Student mobility•ERASMUS MUNDUS•Gender balance doctoral students
Central European University:
•Citations•ERASMUS MUNDUS•Memberships in editorial boards•Scientific prizes won by staff•Staff teaching in summer schools•International staff•International doctorates•International Master‘s students•Student judgements:
• Advisory• Websites• rooms