S o y o u r e a l l y w a n t t o b e a s s e s s e d b y u s ? A s s e s s

y o u r s e l f f i r s t !

( U s i n g u p f r o n t S e l f - s e l e c t i o n a n d S e l f -A s s e s s m e n t t o o l s i n l a r g e s c a l e s e l e c t i o n

p r o c e s s e s )

Gilles Guillard – EPSO Nicoletta Vullo - PROMETRIC

European Personnel Selection Office

9/11/2015 2

▪ EPSO selects highly qualified staff for :

The EU Institutions

9/11/2015 3

EU selection process – Annual cycles

9/11/2015 4

A few figures

9/11/2015 5

▪ Since creation of EPSO in 2003: ▪ Over 600.000 candidates have participated in EPSO

selection processes

▪ Over 450.000 EPSO candidates have taken a computer-based test delivered with Prometric

▪ Over 52.000 CBT exams have been delivered in 2014

▪ Between 1 and 2 % of all candidates in EU open competitions are successful and can be recruited

▪ Some competitions have attracted up to 52.000 applicants for approx. 300 positions offered

What is the issue ?

9/11/2015 6

▪ EPSO is bound by law to test all applicants but only very few will be successful… ▪ High financial costs for the organisation

▪ Risks of delay for timely completion of the selection processes

▪ Potential large gaps in cultural/organisational fit in the initial pool of candidates

▪ Potential large gaps in ability and skills compared to requirements to pass the first phase of the competition

Solution ?

9/11/2015 7

▪ Use technological solution provided by Prometric to support the introduction of compulsory Self-selection and Self-assessment

▪ For selection process with a high level of attractiveness, all potential candidates must take several online tests before being allowed to apply

▪ SST and SAT are tools to support the decision-process of individuals to apply or not to EU selection procedures

Application process

9/11/2015 8

First assess your potential fit with the organisation…

9/11/2015 9

…then assess your abilities and skills prior to actual tests

9/11/2015 10

Self-selection EU Career, My Career (I)

9/11/2015 11

▪ First online compulsory test ▪ Objective: raising awareness about

applicants' potential fit within EU Institutions ▪ Focus on 3 key areas: ▪ Organisational citizenship behaviour

▪ EU working environment

▪ Professional skills attitudes

Self-selection EU Career, My Career (II)

9/11/2015 12

▪ Compulsory but not eliminatory ▪ Now available in 24 EU languages ▪ Accessible online 24/7 only during application

window (usually one month) ▪ MCQ (+/- 20 questions) ▪ Timed + pass mark ▪ Possibility to see correct answer/feedback

immediately (educational/branding) ▪ Content developed in-house (psychologists +

SMEs) and now adapted to specific job profiles

EU Career, My Career

9/11/2015 13

EU Career, My Career

9/11/2015 14

Self-assessment (I)

9/11/2015 15

▪ Second suite of online test ▪ Objective: provide potential applicants with

a free testing experience to allow them to assess their chances of success ▪ Different tests: ▪ Cognitive abilities (VR, NR, AR)

▪ SJT

▪ Specific skills tests (e.g. language proficiency for Translators)

Self-assessment (II)

9/11/2015 16

▪ Compulsory but not eliminatory ▪ Available in 24 EU languages (SJT in 3 languages) ▪ Accessible online 24/7 during application window

(usually one month) AND beyond to allow practice and familiarisation with types of tests

▪ MCQ (generally 50 % of questions compared to actual exam)

▪ Timed + pass mark ▪ Correct answers are NOT given away ▪ Content extracted from actual EPSO item bank and

used in past competitions ("second life" of items)

Self-Assessment (VR)

9/11/2015 17

Self-Assessment (NR)

9/11/2015 18

Feedback ?

9/11/2015 19

Feedback EU Career, My Career

9/11/2015 20

Feedback Self-assessment tests

9/11/2015 21

Prometric

9/11/2015 22

▪ A trusted and market leader of technology-enabled testing and assessment

▪ Committed to a set of values that get the right test to the right location at the right time and to the right test taker

▪ Supporting candidates worldwide who take more than 9 million tests each year

▪ http://www.prometric.com

▪ We support the EPSO since 2005 in their effort to select the right candidate for the right job and in making the selection process better, faster and at a less expense;

▪ We have implemented innovative, tailored solutions to meet the EPSO needs, including: ▪ Multiple choice exams;

▪ Case Studies;

▪ Audio-Video exams;

▪ E-Trays;

▪ In the EU24 languages and across all the EU28 member states and WW

Suppor ting the EPSO

9/11/2015 23

▪ Tailored solution: ▪ A full integration between the EPSO registration process and the

IBT testing environment, including seamless navigation and consistent look and feel;

▪ No login or data entry by candidates to access the exams;

▪ A dynamic presentation of content in multiple languages;

▪ Candidate support in the three EU languages

IBT Implementation

9/11/2015 24

IBT Landing Page

9/11/2015 25

IBT exams delivered – 2014 over view

26

500,000 IBT tests & surveys delivered To a total of 270,000 candidates In up to 24 languages Minimal candidate complaints

Cycle Exam Title Test volume Pass rateAST 3 Self-assessment Part I: Reasoning test 57,815 30%AST 3 Self-Assessment Part II: Professional skills test 12,297 33%AD Compulsory self-assessment Part I 200,252 10%AD Compulsory self-assessment Part II SJT 100,449 25%ADL Self-Assessment Translators Part I Reasoning Tests 15,892 11%ADL Compulsory Self-Assessment Part II Language Test 17,907 51%General EU CAREER, MY CAREER? 50,194 51%General EU-LAUFBAHN, MEINE LAUFBAHN? 8,998 64%General UNE CARRIERE EUROPEENNE, UNE CARRIERE POUR MOI? 12,545 53%General EPSO Enquête de satisfaction - French 4,450 n/aGeneral EPSO Survey - English 17,958 n/aGeneral EPSO Umfrage - German 4,513 n/a

503,270

Some of the lessons learned

9/11/2015 27

▪ Reduced number of actual applicants (between 25 to 50 % compared to SST/SAT): costs and testing constraints driven down

▪ Increased commitment and motivation of actual applicants (decreasing number of dropouts)

▪ Extremely positive feedback from test takers on SST/SAT

▪ Increased transparency in EU selection processes

Future prospects ?

9/11/2015 28

▪ Comparative assessment of quality of successful candidates and scores achieved in SST/SAT (requires data capture at an early stage) ?

▪ SST/SAT compulsory AND eliminatory ? ▪ Migration of EPSO exams from IBT to the new TC Net

platform ▪ Next Generation - Provides the benefits of Web 2.0 and RIA standards ▪ Maintainability – Built on the ASP.NET platform ▪ Usability - Implements HTML5 leveraging its rapid response capabilities and

enhanced UI ▪ Design & Security –

▪ 3-tier architecture

▪ WCAG2.0/508

▪ PCI compliance and Architectural Security Risks audited by independent 3rd party

Thank you !

9/11/2015 29

▪ White paper available, just ask for it !

▪ Contact details:

▪ EPSO – Gilles GUILLARD – Head of Unit "E-selection and test development" + 32 (0)2 299 50 20 / mailto:gilles.guillard@ec.europa.eu

▪ Prometric – Nicoletta VULLO – Director of Account Management + 39 340 7798 460 / mailto:nicoletta.vullo@prometric.com

QUESTIONS ?