Access to microdata in Europe

Presented by Michel Isnard – Insee

DwB Training Course, Barcelona, 21-23 Jan. 2015

Introduction

• Access to European micro data

• Access to French micro data

• Access to UK micro data

European microdata

• Eurostat, the statistical agency of the Commission, receives harmonised micro data from National Statistical Institutes Mainly “household” data (SILC, LFS, ESS, …) Some “business data” (CIS, …)

• Harmonised data, but poorer than the national counter part

• Regulation 223/2009 – Article 23 Access can be given to researchers for scientific purposes Agreement of the NSI Modalities fixed in new Commission Regulation n°557/2013

Access to European microdata

• Entities recognized

• Accreditation of research project and researchers

• Types of files accessed

• Agreement of Member States

Entities recognized

• Every entity employing researchers to be accredited must be recognized

Purpose of the entity : statute, mission, .., must include reference to research Established record or reputation as a body producing quality research and making it

publicly available The research entity must be independent and separated from policy areas Technical and infrastructure requirements assuring security of data should be in place

• Every entity shall undertake a confidentiality agreement covering all researchers of the entity accessing to confidential data and sanctions must be announced.

• List published by Eurostat

Assessment of a research project• Criteria to be used

Legitimate purpose of the research Explanation why this purpose cannot be fulfilled using non-confidential data; Entity requesting access; List of individual researchers who will have access to the data; Access facilities to be used; Data sets to be accessed, the methods of analysing them; and intended results of the research to be published or otherwise disseminated

• Individual confidentiality declarations

Files accessed

• Scientific Use Files Sent to the entity on a CD-ROM Almost anonymized, lower risk

• Secure Use Files Access through an access facility accredited by Eurostat

Presently Eurostat in Luxembourg In a short term : National Statistical Institutes Then National Statistical Authorities And ….

Access to French microdata

Access to French microdata

• French microdata are available on different forms : Public Use Files Scientific Use Files Confidential Files

• Almost every data collected for official statistics are available : Except data covered by another secret : fiscal, national security, …

Public Use Files

• Available at http://www.insee.fr/fr/bases-de-donnees/fichiers-detail.asp

• Description in French

• Mainly census, civil status data and Labour Force Survey

• Downloadable from foreign countries

Scientific Use Files

• Data from household surveys available through French Data Archive : Reseau Quetelet

• www.reseau-quetelet.cnrs.fr

• Website in English, but data description in French (to be translated ..)

• Possible from foreign counties

• No SUF from business surveys

Confidential Files (1)

• Available from Business and Household Surveys and employer-employee data Except data covered by another secret : fiscal, national security, …

• Researchers submitted to the same penal sanctions as the statisticians

• European countries

• Access through French national secure center : CASD in Genes

Confidential Files (2) : The SD-Box

• Procedures in 4 steps : Opinion of then French Statistical Confidentiality Committee, chaired by a

judge and composed by researchers, statisticians and representants of surveyed persons

Evaluation of the scientific project Need of the confidential data

Agreement by the statistical services Decision by the French national Archives Formation to the use of CASD, taking place in Paris

Confidential Files (3)

•Duration of the process : 2-3 months

•Use of SD Box not free Except for DwB sponsored projects

•More information available on : http://www.cnis.fr/cms/Accueil/activites/_trois_comites/

Comite_du_secret_statistique Page in French, but request form in English

http://www.reseau-quetelet.cnrs.fr/spip/rubrique.php3?id_rubrique=81&lang=en

Page in English

Confidential Files (4)

Access to UK Microdata

Secure Data Access at UKDS

(prepared by Reza Afkhami)

About the Secure Data Access

• For the academic research community in the UK• Delivered by the UK Data Service/Archive• Funded by the Economic and Social Research Council• Supported by the Office for National Statistics and BIS• Government and ISO 27001 accredited

Using the Service

• Unprecedented access to sensitive data• Unprecedented trust in researchers

• UK academics – institutional desktop access• Non-resident researchers – safe room onsite at UKDA• Secure remote access (log in via a web browser to launch a remote

desktop) – can’t download, copy and paste, print• Access to standard software (SPSS, Stata, R, Word, Powerpoint etc)• Conduct all research within the secure environment• Final outputs are checked by the team for Statistical Disclosure Control

before being released

Application Process

• Register with and order through the Economic and Social Data Service

• Complete application form – vetted by us and data owners

• Attend mandatory face-to-face training data security and personal responsibility, including legal background, security model,

breaches and penalties Statistical Disclosure Control - how to make statistical outputs safe and what principles

are used, including hands-on exercises using the Secure Data Service - about the service and how to use it, how to obtain

outputs and how to use the service safely

• Complete Service User Agreement that outlines terms and conditions of use of the service and requires institutional signature

• Receive member logon at the end of training session