Methodological refinements for 2015 and beyond

2015/2016

2

Everyone is facing changes No one knows what's going on. And everyone is changing places Still the world keeps moving on.

Changes Hugh Laurie (2013)

CAREER DEVELOPMENT

EDUCATIONAL ACHIEVEMENT

and

INTERNATIONAL MOBILITY

by fostering

MOTIVATEDPEOPLE

To enable

POTENTIALto achieve their

around the

3

OUR AUDIENCE

PROSPECTIVE (INTERNATIONAL)

STUDENTS

ACADEMICS

PROSPECTIVE PARTNERS

SCHOLARSHIP PROVIDERS

CURRENT STUDENTS

EMPLOYERSUNIVERSITY

LEADERS

GOVERNMENT

ALUMNI

4

OU

R A

PP

RO

AC

H

WORLDCLASS

UNIVERSITY

5

ACADEMICREPUTATION

FACULTY STUDENT

CITATIONS PER FACULTY

EMPLOYER REPUTATION

INT’L STUDENTS

INT’L FACULTY

Consistent, simple methodology

Stable results

Discipline independent

Language independent

Low dependence on self-reporting

6

powered by

7

The most dangerous phrase in the language is, “We’ve always done

it this way.”

Rear Admiral Grace Hopper Pioneering Computer Scientist

1906-1992

WHAT’S NEW SINCE 2014?8

FACULTY AREA NORMALIZATION

INTRODUCED AFFILIATION THRESHOLD FOR PAPERS

ADDED 28 NEW UNIVERSITIES

REMOVED SUPERFLUOUS

SCOPUS CONTENT TYPES

EXTENDED SURVEY

WINDOWS TO FIVE YEARS

SCOPUS CONTENT TYPES

9

In consultation with Elsevier, some (typically not citation yielding) content types have been excluded from analysis:

Article

Review

Conference Paper

Book

Book Chapter

Article in Press

Business Article

Abstract Report

Conference Review

Editorial

Erratum

Letter

Note

Press Release

Short Survey

IN OUT

Yerevan Physics Institute, Yerevan, Armenia;b Institut für Hochenergiephysik der OeAW, Wien, Austria;c National Centre for Particle and High Energy Physics, Minsk,Belarus;d Research Institute for Nuclear Problems, Minsk, Belarus;e Universiteit Antwerpen, Antwerpen, Belgium;f Vrije Universiteit Brussel, Brussel, Belgium;g UniversitéLibre de Bruxelles, Bruxelles, Belgium;h Ghent University, Ghent, Belgium; Université Catholique de Louvain, Louvain-la-Neuve, Belgium;j Université de Mons, Mons,Belgium; Centro Brasileiro de Pesquisas Fisicas, Rio de Janeiro, Brazil l Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil m Instituto de Fisica Teorica,Universidade Estadual Paulista, Sao Paulo, Brazil n Institute for Nuclear Research and Nuclear Energy, Sofia, Bulgaria o Institute of System Engineering and Robotics,Sofia, Bulgaria p University of Sofia, Sofia, Bulgaria q Institute of High Energy Physics, Beijing, China r State Key Lab. of Nucl. Phys. and Tech., Peking University, Beijing,China s Universidad de Los Andes, Bogota, Colombia t Technical University of Split, Split, Croatia u University of Split, Split, Croatia v Institute Rudjer Boskovic, Zagreb,Croatia w University of Cyprus, Nicosia, Cyprus x Charles University, Prague, Czech Republicy Academy of Scientific Research and Technology of the Arab Republic ofEgypt, Egyptian Network of High Energy Physics, Cairo, Egypt z National Institute of Chemical Physics and Biophysics, Tallinn, Estonia aa Department of Physics,University of Helsinki, Helsinki, Finland ab Helsinki Institute of Physics, Helsinki, Finland ac Lappeenranta University of Technology, Lappeenranta, Finland ad DSM/IRFU,CEA/Saclay, Gif-sur-Yvette, Franceae Laboratoire Leprince-Ringuet, Ecole Polytechnique, IN2P3-CNRS, Palaiseau, France af Institut Pluridisciplinaire Hubert Curien,Université de Strasbourg, Université de Haute Alsace Mulhouse, CNRS/IN2P3, Strasbourg, France ag Centre de Calcul de l'Institut National de Physique Nucleaire et dePhysique des Particules, CNRS/IN2P3, Villeurbanne, France ah Université de Lyon, Université Claude Bernard Lyon 1, CNRS-IN2P3, Institut de Physique Nucléaire deLyon, Villeurbanne, France ai E. Andronikashvili Institute of Physics, Academy of Science, Tbilisi, Georgia aj Institute of High Energy Physics and Informatization, TbilisiState University, Tbilisi, Georgia ak RWTH Aachen University, I. Physikalisches Institut, Aachen, Germany al RWTH Aachen University, III. Physikalisches Institut A,Aachen, Germany am RWTH Aachen University, III. Physikalisches Institut B, Aachen, Germanyan Deutsches Elektronen-Synchrotron, Hamburg, Germany ao University ofHamburg, Hamburg, Germany ap Institut für Experimentelle Kernphysik, Karlsruhe, Germany aq Institute of Nuclear Physics Demokritos, Aghia Paraskevi, Greecear University of Athens, Athens, Greece as University of Ioánnina, Ioánnina, Greece at KFKI Research Institute for Particle and Nuclear Physics, Budapest, Hungaryau Institute of Nuclear Research ATOMKI, Debrecen, Hungary av University of Debrecen, Debrecen, Hungary aw Panjab University, Chandigarh, India ax University ofDelhi, Delhi, India ay Saha Institute of Nuclear Physics, Kolkata, India az Bhabha Atomic Research Centre, Mumbai, India ba Tata Institute of Fundamental Research - EHEP,Mumbai, India bb Tata Institute of Fundamental Research - HECR, Mumbai, India bc Institute for Research in Fundamental Sciences (IPM), Tehran, Iran bd INFN Sezione diBari, Bari, Italy be Università di Bari, Bari, Italy bf Politecnico di Bari, Bari, Italy bg INFN Sezione di Bologna, Bologna, Italy bh Università di Bologna, Bologna, Italy bi INFNSezione di Catania, Catania, Italy bj Università di Catania, Catania, Italy bk INFN Sezione di Firenze, Firenze, Italy bl Università di Firenze, Firenze, Italy bm INFN LaboratoriNazionali di Frascati, Frascati, Italy bn INFN Sezione di Genova, Genova, Italy bo INFN Sezione di Milano-Bicocca, Milano, Italy bp Università di Milano-Bicocca, Milano,Italy bq INFN Sezione di Napoli, Napoli, Italy br Università di Napoli Federico II, Napoli, Italy bs INFN Sezione di Padova, Padova, Italy bt Università di Padova, Padova, Italybu Università di Trento (Trento), Padova, Italy bv INFN Sezione di Pavia, Pavia, Italy bw Università di Pavia, Pavia, Italy bx INFN Sezione di Perugia, Perugia, Italyby Università di Perugia, Perugia, Italy bz INFN Sezione di Pisa, Pisa, Italy ca Università di Pisa, Pisa, Italy cb Scuola Normale Superiore di Pisa, Pisa, Italy cc INFN Sezione diRoma, Roma, Italy cd Università di Roma La Sapienza, Roma, Italy ce INFN Sezione di Torino, Torino, Italy cf Università di Torino, Torino, Italy cg Università del PiemonteOrientale (Novara), Torino, Italy ch INFN Sezione di Trieste, Trieste, Italy ci Università di Trieste, Trieste, Italy cj Kangwon National University, Chunchon, South Koreack Kyungpook National University, Daegu, South Korea cl Chonnam National University, Institute for Universe and Elementary Particles, Kwangju, South Korea cm KoreaUniversity, Seoul, South Korea cn University of Seoul, Seoul, South Korea co Sungkyunkwan University, Suwon, South Korea cp Vilnius University, Vilnius, Lithuaniacq Centro de Investigacion y de Estudios Avanzados del IPN, Mexico City, Mexico cr Universidad Iberoamericana, Mexico City, Mexico cs Benemerita UniversidadAutonoma de Puebla, Puebla, Mexico ct Universidad Autónoma de San Luis Potosí, San Luis Potosí, Mexico cu University of Auckland, Auckland, New Zealand

10

1 PAPER, 1949 CITATIONS...

WHERE DO CITATIONS COME FROM?

11

Arts & Humanities

Engineering & Technology

Life Sciences & Medicine

Natural Sciences

Social Sciences & Management

The average distribution of citations across faculty areas for QS mapped institutions in Scopus (2010-2014)

THE TECHNICAL BIT

𝑁𝑇𝐶𝐶 ≡𝑛

𝑛𝑓𝑎

𝑓=1

5

𝐶𝑓𝑤𝑓𝑎𝑓

𝑤𝑓 ≡𝑛𝑓𝑎

5𝑥𝑓

𝑎𝑎ℎ,𝑠𝑠 ≡𝑟𝑓−𝑟𝑓𝑚𝑖𝑛

1−𝑟𝑓𝑚𝑖𝑛

𝑟𝑎ℎ,𝑠𝑠 ≡ 𝑚𝑖𝑛𝑝𝑓

𝑝𝑓𝑚𝑎𝑥1

𝑎𝑒𝑡,𝑙𝑠,𝑛𝑠 ≡5− 𝑎𝑎ℎ+𝑎𝑠𝑠

3

12

𝑛 = total citation count prior to normalization𝑛𝑓𝑎 = sum of total citation count across the five faculty areas

𝐶𝑓 = count of citations for the given faculty area for the institution in question

𝑤𝑓 = weighting factor for the given faculty area

𝑎𝑓 = weighting adjustment for given faculty area

𝑥𝑓 = count of citations for the given faculty area𝑟𝑓 = ratio of a country’s papers in the faculty area to the most

productive country in the faculty area, in relative terms𝑟𝑓 𝑚𝑖𝑛 = the lowest value of 𝑟𝑓 across all countries

𝑓 = current faculty area, which can be one of:𝑎ℎ = Arts & Humanities

𝑒𝑡 = Engineering & Technology 𝑙𝑠 = Life Sciences & Medicine𝑛𝑠 = Natural Sciences 𝑠𝑠 = Social Sciences & Management

𝑝𝑓 = mean proportion of papers from the faculty area for the institution’s home country

𝑝𝑓 𝑚𝑎𝑥 = the maximum value of 𝑝𝑓 where the paper count in that faculty area for the given country exceeds the global average

THE TECHNICAL BIT - EXAMPLE

𝑁𝑇𝐶𝐶 ≡𝑛

𝑛𝑓𝑎

𝑓=1

5

𝐶𝑓𝑤𝑓𝑎𝑓

𝑁𝑇𝐶𝐶 ≡ 0.86

32,962+14,303+12,110+17,330+19,144

𝑁𝑇𝐶𝐶 ≡ 81,979

13

𝑛 = 44,900,880

𝑛𝑓𝑎 = 52,497,999

𝑎ℎ 𝑒𝑡 𝑙𝑠 𝑛𝑠 𝑠𝑠

𝐶𝑓 1,905 12,515 26,764 20,263 8,069

𝑥𝑓 581,786 9,959,717 25,156,050 13,309,271 3,491,175

𝑤𝑓 18.05 1.05 0.42 0.79 3.01

𝑟𝑓 96.0% 81.0%

𝑟𝑓 𝑚𝑖𝑛 3.0% 10.0%

𝑎𝑓 95.9% 108.4% 108.4% 108.4% 78.9%

𝑝𝑓 5.80% 20.25% 35.92% 20.57% 17.46%

𝑝𝑓 𝑚𝑎𝑥 6.04% 21.58%

𝐶𝑓𝑤𝑓𝑎𝑓 32,962 14,303 12,110 17,330 19,144

REFINEMENT TIMELINE

Publish

Eureka!? Renewed partnership

with Elsevier helps

develop even stronger

understanding of and

access to Scopus data

02

Initial Model

Elsevier Renewal

Revised Model

Changes Adopted

The initial model

was developed in

August 2014 after

the initial idea to

use faculty areas

emerged

01

Revised model correcting

for language reality

modelled and proposed to

QS global advisory board.

Meets strong positive

support.

03

Following Advisory

Board engagement

new approach is

adopted and folded

into new rankings

analysis

04

Simultaneous publication

across channels and partners.

Press and social media

campaigns initiated

05

14

Key communication

milestones

15

1 1 1

22

2

43

4 4

55

5

6 6

7 7 7

8 8 8

9 9 9

10 1010

11 11

12 12 12

13 13 13

1414

14

15 15

16 16 16

1717 17

18

1919

192016

17

London Business School

UC San Francisco

Nanyang Technological University

Johns Hopkins University

City University of Hong Kong

University of Western Australia

KAUST

BEFORE

18

AFTER

1% 6%51%17% 24% 15% 24% 11%26%23%LIFE SCIENCES &

MEDICINEARTS &

HUMANITIESSOCIAL SCIENCES &

MANAGEMENTENGINEERING & TECHNOLOGY

NATURAL SCIENCES

19

Essentially, all models are wrong,

but some are useful

George E.P. Box“Accidental Staistician”

1919-2013

20

CONTEXTS

DIGGING DEEPER

21

LEAGUE TABLES

SUBJECTS

ASPECTS TYPES

QS Global 200 Business Schools

CLASSIFICATIONS

PhiladelphiaDecember 7-9 2015

www.reimagine-education.com

THANK YOU

topuniversities.com iu.qs.com

ben@qs.comintelligenceunit@qs.com

facebook.com/ universityrankings

@bensowter@worlduniranking#QSWUR

linkedin.com/in/bensowter

23