The European Commission’s science and knowledge service · Big Data and non-traditional data for...

25
The European Commission’s science and knowledge service Joint Research Centre

Transcript of The European Commission’s science and knowledge service · Big Data and non-traditional data for...

Page 1: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

The European Commission’s scienceand knowledge service

Joint Research Centre

Page 2: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

A changing migration data landscape?

Michele Vespe

European Commission, Joint Research Centre,

Knowledge Centre for Migration and Demography (KCMD)

Page 3: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Knowledge Centre on Migration and Demography

Page 4: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Fragmented & scattered data

Discovered, filtered & quality checked catalogue of data sources

Pre-processed data access & visual analytics

KCMDDYNAMIC DATA HUB

MIGRATIONDATA CATALOGUE

To help policy makers, researchers and stakeholders to discover and use data

https://bluehub.jrc.ec.europa.eu/catalogues/data

~140 datasets

To help policy makers, researchers and stakeholders to analyse data

https://bluehub.jrc.ec.europa.eu/migration/app/index.html

~20 datasets

KCMD Initiatives

Page 5: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

KCMD - Dynamic Data Hub

Global stock of migrants by UNDESA

Latest revision just released -data for 1st

Jan 2017

Migrants in GeorgiaDynamic Data Hub

Page 6: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

KCMD - Dynamic Data Hub

Global stock of migrants by UNDESA

Latest revision just released -data for 1st

Jan 2017

Dynamic Data HubGeorgian Diaspora (reverse function)

Page 7: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

KCMD - Dynamic Data Hub

Dynamic Data Hub

EUROSTAT statistics (reverse)

Page 8: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Big Data for Migration (BD4M) Alliance

The European Commission and the International Organization for Migration launch the Big Data for Migration Alliance (BD4M), a global initiative to unlock the potential of big data sources and provide valuable insights related to migration

Page 9: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential:

1. Spatial Coverage & Periodicity (e.g. Air Traffic Data)

2. Timeliness (e.g. Facebook)

3. Characteristics (e.g. LinkedIn)

4. Granularity in space (e.g. CDR)

Page 10: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential:

1. Spatial Coverage & Periodicity (e.g. Air Traffic Data)

2. Timeliness (e.g. Facebook)

3. Characteristics (e.g. LinkedIn)

4. Granularity in space (e.g. CDR)

Page 11: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

December 2015 March 2016

Air passenger traffic, COL➝ESP Air passenger traffic, PER➝ESP

Migration data innovation potential I:Spatial Coverage & Periodicity

Page 12: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration flows, COL➝ESP Migration flows, PER➝ESP

Migration data innovation potential I:Spatial Coverage & Periodicity

Page 13: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Visa waiver for Georgia, 28 March 2017

Migration data innovation potential I:Spatial Coverage & Periodicity

Page 14: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Air traffic passenger data - Mobility

Page 15: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Air traffic passenger data - Mobility

Page 16: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Taking into account: - Diasporas/networks - GDP differential - Trade & business - Geographical distance - Mobility channels

Mod

el

Pred

ictio

nAi

r Pas

seng

er

Raw

Migration data innovation potential I:Spatial Coverage & Periodicity

Page 17: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential:

1. Spatial Coverage & Periodicity (e.g. Air Traffic Data)2. Timeliness (e.g. Facebook)3. Characteristics (e.g. LinkedIn)4. Granularity in space (e.g. CDR)

Page 18: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Big Data and non-traditional data for migration

The research has provided insights to several Commission services

Venezuelans in Spain: latest EU official statistics, Spanish Statistical Office, Facebook Network data (improved frequency update & timeliness)

S. Spyratos, M. Vespe, F. Natale, E. Zagheni, I. Weber, M. Rango, working paper on Migration Data using social Media: a European Perspective

Latest EU official statistics: 1-Jan-17,Spanish Statistical Office: 1-Jan-18

Facebook Advertising Platform data: high refresh rate – real time census

Page 19: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential:

1. Spatial Coverage & Periodicity (e.g. Air Traffic Data)2. Timeliness (e.g. Facebook)3. Characteristics (e.g. LinkedIn)4. Granularity in space (e.g. CDR)

Page 20: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential III:Characteristics

Example of highly-skilled migrants using LinkedIn advertising

platform

370

270220 220

190150 140 130 130

100 80 80 70 50 40 40 40 30 30 30 30 20 20 10 10 10

… In Germany

Page 21: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential:

1. Spatial Coverage & Periodicity (e.g. Air Traffic Data)2. Timeliness (e.g. Facebook)3. Characteristics (e.g. LinkedIn)4. Granularity in space (e.g. CDR)

Page 22: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Assembling the data from Census 2011

Census tract: ES, IT, IE, UK, FR Grid 100x100 m: DE Postal codes NL

Migration data innovation potential IV: Granularity (space)

D4I - Data for Integration

Data Challenge

Page 23: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

D4I - Data Challenge

• Migration and housing market in Italy

• Migration and electoral outcomes (NL, IT, ES, DE)

• Temporal evolution of segregation (2001 vs 2011 Census)

External projects through the Data Challenge

KCMD internal projects

Migration data innovation potential IV: Granularity (space)

Page 24: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Migration data innovation potential IV: Granularity (space)

Density of mobile phonetraffic with China and areas of highest concentration of migrants from 2011 Census

Sources: - Italian Census Data & - Call Detail Records, Telecom Italia

Page 25: The European Commission’s science and knowledge service · Big Data and non-traditional data for migration. The research has provided insights to several Commission services. Venezuelans

Any questions?You can find me at @M_Vespe & [email protected]