Computer Based Testing at Selor

57
CBT @ Selor Past, present & future EPSO Seminar 19 October 2012

description

Presentation at EPSO CBT seminar

Transcript of Computer Based Testing at Selor

CBT @ Selor Past, present &

futureEPSO Seminar 19 October 2012

AGENDA

Intro: Testing @ Selor

1. History

2. PresentSelor Screening Model

Testing Process

Portfolio

3. Future Innovations

4. Selor Centre of Expertise

1. INTRO: TESTING @ SELOR

What society & media think we do

What we actually do

What some candidates think we do

What some people think we do

What some clients think we do

History

2. HISTORY

Knowledge (paper/pencil)

CBT (competency management)

CBT (Selor screening model)

First PC-testing: early 90ies

Mass exams

Knowledge based

Paper & pencil

1. HISTORY

2004 - 2011

Competency based

Full CBT

Function based

1. HISTORY

2011 - …

Competency based

CBT

Screening model

1. HISTORY

PresentSELOR SCREENING MODEL

2. PRESENT: SCREENING MODEL

The screening model

Module 0 Module 1Module 2

Event 1

Module 2

Event 2

2. PRESENT: SCREENING MODEL

Entry ticket or degree/diploma

Generic Screening

PC

Specific Screening

PC/interview

Module 0

Module 1

Module 2

2. PRESENT: SCREENING MODEL

“Basic competencies and cognitive abilities proven by a degree of a certain level or the equivalent of the degree”

Module 0

Module 1

Module 2

2. PRESENT: SCREENING MODEL

“Generic competencies and cognitive abilities equivalent to the level of

functioning””

Module 0

Module 1

Module 2

2. PRESENT: SCREENING MODEL

“Specific abilities, fit, motivation, experience, competencies, knowledge

necessary for the function”

Module 0

Module 1

Module 2

2. PRESENT: SCREENING MODEL

Module 0

Module 1

Module 2

Exemption

Development Buffer

Exemption

Development Buffer

No exemption

Pass/Fail Pass/Fail

Ranking

PresentTESTING PROCESS

2. PRESENT: TESTING PROCESS

Competencies

Information Management

Task Management

PeopleManagement

InterpersonalManagement

Personal Management

Levels: D A5

f.i. File Manager f.i. Teamleader

2. PRESENT: TESTING PROCESS

File Manager: Level C

2. PRESENT: TESTING PROCESS

Job description

2. PRESENT: TESTING PROCESS

Overview of the requirements for the job

Competencies: generic and technical

Other requirements: degree and if necessary for the job: job experience

2. PRESENT: TESTING PROCESS

First step: computer-based tests

Overview of the selection procedure

Second step: interview

Client has a vacancy: A2 Teamleader (IT development)

Selor and client determine based on the function description:

• Profile• Competencies• Degree• Experience

• Testing procedure

2. PRESENT: TESTING PROCESS

2. PRESENT: TESTING PROCESS

Manager A2Information

ManagementTask

ManagementPeople

ManagementInterpersonal Management

Personal Management

Understanding information

Executing tasks Sharing knowledge and

know-how

Communicating * Showing respect

Treating information

Structuring tasks Supporting Active Listening * Adapting

x Analysing information

x Problem solving Managing employees

K Teamwork K Showing reliability

X Integrating information

X Decision taking Motivating employees

K Acting in a service-oriented

manner

* Showing commitment

Innovating Organising X Developing employees

X Advising * Managing stress

Conceptualising Managing the service

Building teams /// Influencing K Developing oneself

Insight in the organisation

Managing the organisation

Leading teams Establishing relationships

K Achieving objectives

Developing a vision

Controlling the organisation

Inspiring Networking Showing organizational commitment

2. PRESENT: TESTING PROCESSCompetencies Module 0 Module 1 Case Interview

Integrating information X X

Decision taking X X X

Developing employees X

Acting service-oriented X X

Advising X

Influencing X

Developing oneself X

Achieving objectives X X

Oral communication X

Technical competencies (IT Projectmanagement, JAVA, .NET,…)

X

Generic part (module 0 and 1) of the selection procedure, computer-based tests evaluating:

• Abstract reasoning

• Information management

• Task management

• Key competencies: Teamwork, Acting in a service-oriented manner, Showing reliability,

Developing oneself, Achieving objectives

Specific part (module 2) of the selection procedure, all sorts of testing methods of our test portfolio

For each level a set of tests that corresponds to the difficulty and competencies of each level

2. PRESENT: TESTING PROCESS

2. PRESENT: TESTING PROCESS

RESERVE LIST CLIENT

SPECIFICModule 2.1 / 2.2

GENERICModule 0/1 On-going

PHASE 2Quality check Q check Diploma / Q-check Experience

PHASE 1PC-check Diploma / Experience / Exemption

CANDIDATE ONLINE SUBSCRIPTION

Competition Closing Date

+ 8 days

Uniformity

PC-Testing

Teamwork

Acting in a service-oriented manner

Showing reliability

Developing oneself

Achieving objectives

Efficiency

EfficiencyOngoing module 0 + 1

PresentPORTFOLIO

2. PRESENT: PORTFOLIO

Generic part (module 0 and 1) of the selection procedure, computer-based tests evaluating:

• Abstract reasoning

• Information management

• Task management

• Key competencies: Teamwork, Acting in a service-oriented manner, Showing reliability,

Developing oneself, Achieving objectives

Specific part (module 2) of the selection procedure, all sorts of testing methods of our test portfolio

For each level a set of tests that corresponds to the difficulty and competencies of each level

2. PRESENT: PORTFOLIO

SJT SJT

ABS PCIB

ABS

2. PRESENT: PORTFOLIO

EVENT 1

EVENT 2

PC INTERVIEW

e.g. A-LEVEL: SJT + ABSInformation

ManagementTask

ManagementPeople

ManagementInterpersonal Management

Personal Management

Understanding information

Executing tasks Sharing knowledge and

know-how

Communicating Showing respect

Treating information

Structuring tasks Supporting Active Listening Adapting

Analysing information

Problem solving Managing employees

Teamwork Showing reliability

Integrating information

Decision taking Motivating employees

Acting in a service-oriented

manner

Showing commitment

Innovating Organising Developing employees

Advising Managing stress

Conceptualising Managing the service

Building teams Influencing Developing oneself

Insight in the organisation

Managing the organisation

Leading teams Establishing relationships

Achieving objectives

Developing a vision

Controlling the organisation

Inspiring Networking Showing organizational commitment

Abstract Reasoning (ABS)

e.g. A-LEVEL: SJT + ABS + PCIBInformation

ManagementTask

ManagementPeople

ManagementInterpersonal Management

Personal Management

Understanding information

Executing tasks Sharing knowledge and

know-how

Communicating Showing respect

Treating information

Structuring tasks Supporting Active Listening Adapting

Analysing information

Problem solving Managing employees

Teamwork Showing reliability

Integrating information

Decision taking Motivating employees

Acting in a service-oriented

manner

Showing commitment

Innovating Organising Developing employees

Advising Managing stress

Conceptualising Managing the service

Building teams Influencing Developing oneself

Insight in the organisation

Managing the organisation

Leading teams Establishing relationships

Achieving objectives

Developing a vision

Controlling the organisation

Inspiring Networking Showing organizational commitment

Abstract Reasoning (ABS)

&

ABS: Abstract Reasoning

ABS: Abstract Reasoning

ABS: Abstract Reasoning

PCIB: Computer-based in tray excercice

PCIB: Computer-based in tray excercice

SJT: Situational Judgement Test

SJT: Situational Judgement Test

SJT: Situational Judgement Test

EVENT 1

EVENT 2

Abilities Personality

Technical competencies Generic competencies

Measurement objective

Module 2: testportfolio

Module 2: testportfolio

Future Innovations

3. FUTURE INNOVATIONS

SELOR CLIENTS @ HOME

CERTIFICATION! 100% DIGITAL!

Decentralization of testing

3. FUTURE INNOVATIONS

Q3Q2Q1

?

??

?

??

?

ADAPTIVE TESTING ITEM BANK

VIDEO BASED(some tests already

developed)SERIOUS GAMING

3. FUTURE INNOVATIONS

Full web accessibility for people with disabilities

STAP 1

• Communication

STAP 2

• Request

STAP 3

• RA Analysis• Determine RA

STAP 4

• Adapted selection

STAP 5

• Feedback on RA

STAP 6

• Results

STAP 7

• Recruitment

SELOR CENTRE OF EXPERTISE

Selor Centre of Expertise

Centre of Expertise

Screening Rekrutering

Expertise Selor Academy

Expertise

Diversity Research

Test-ontwikkeling

Screenings-methodologie

Communicatie Andere

Communicatie

Rekruterings-productop maat

Employer branding

DiversiteitScreeningsmethodologieTestontwikkeling

CONTACT

Vincent Van Malderen

Product manager Centre of Expertise Selor

www.selor.be (B2B)

[email protected]

02/788.66.52

@vincentvm

http://be.linkedin.com/in/vincentvanmalderen