European Social Fund

Promoting improvement

Shirley Jones

Introduction

• Purpose of inspection

• Review of evaluation visits to date

• Key findings from evaluation visits

• Going forward

• Overview of the inspection process

• Reporting

• What happens after inspection

Purpose of inspection:Purpose of inspection:

Key messages of improvement from

phase 1

Phase 1 - objectives

• To identify good practice, recognise how to build on this work and where improvement was needed to ensure the achievement of excellence

• To identify what can be done to make things better for young people, adults and the wider community

• To inform stakeholders, including providers and the Department about the quality of service provided – openness and transparency

Initial ETI visits

• Focused on the project’s own self-evaluation processes

• Evaluated how well the project:

- identified their strengths and weaknesses and planned for improvement

Evidence base to date

• 79 organisations delivering 95 ESF projects

• All of the 24 CIF Projects

– (18 of these projects were delivered by providers who also delivered ESF projects)

Examples of effective practice

• The strong advocacy roles on behalf of their participant groups and their commitment to social inclusion

• The experience and expertise of the project teams, including their knowledge and understanding of the target groups and their training and support needs

• The individualised and tailored programmes to meet the needs of the participants

Examples of effective practice• The caring and inclusive ethos

demonstrated in the mutually respectful relationships among the staff and participants

• The increased confidence and enthusiasm for learning expressed by most of the participants

• The collegial approach by the staff to meeting the needs of the participants, which is underpinned by their willingness to engage in appropriate and effective CPD

Examples of effective practice

• The strong focus on the employability needs of the participants and the development of the relevant skills, qualities and/or attributes needed to enhance their employability

Going forward

• Embed the culture and value of SE and QIP processes with staff at all levels across the projects

• Widen the evidence base used to inform SE and QIP processes

• Make more effective use of data, including the use of measurable outcomes to demonstrate more clearly the impact and value of the projects

• Include staff and other key stakeholders more fully in the SE process

Going forward

• Develop further the tracking of participants’ progress including the analysis of distance travelled based on their entry profiles, the qualifications they achieve, and their success in finding and sustaining employment

• Reflect more effectively on own practice and identify good practice more clearly

• Work with other projects to share examples of good practice more widely

Inspection process going forward

Going Forward – What will be different?

• Size and scale of inspection

• Longitudinal two phase inspection model

• Phase 1 - baseline inspection visit – main findings shared with the project and DEL

• Greater focus on first- hand evidence e,g talking to participants, visits to classes, talking to tutors and/or support staff

Going Forward – What will be different?

• Visiting participants in the workplace, talking to employers, etc

• Stronger emphasis on data, measuring progress and impact

• Direct observations of practice

• Second inspection visit within approximately12 months after the baseline will include performance levels and a published report

• The report from the second visit will be published on the ETI website

Going Forward – What will be the same?

• Self-evaluation report and quality improvement plan required as part of the overall process

• The inspection team will share their findings with you at both stages

• The interim period between visits is an opportunity to build on strengths and address areas for improvement

Performance levels

Outstanding

Very Good

Good

Important area(s) for improvement

Requires significant improvement

Requires urgent improvement

Used to report on the quality of:

• Achievement and standards

• Provision for learning

• Leadership and management

•One of four inspection outcomes for overall effectiveness

The organisation has a high level of capacity for sustained improvement in the interest of all the learners. The ETI will monitor the organisation’s progress in addressing any area(s) for improvement through its annual quality improvement planning.

•One of four inspection outcomes for overall effectiveness

The organisation demonstrates the capacity to identify and bring about improvement in the interest of all the learners. The ETI will monitor the organisation’s progress in addressing the area(s) for improvement through its annual quality improvement planning.

•One of four inspection outcomes for overall effectiveness

The organisation needs to address (an) important area(s) for improvement in the interest of all the learners. The ETI will monitor and report on the organisation’s progress in addressing the area(s) for improvement, which includes the need to produce an improvement plan, which will be the basis for a formal follow-up inspection within 12-18 months.

•One of four inspection outcomes for overall effectiveness

The organisation needs to address urgently the significant areas for improvement identified in the interest of all the learners. The ETI will monitor and report on the organisation’s progress in addressing the areas for improvement, which includes the need to produce an improvement plan, which will be the basis for a formal follow-up inspection within 12 -18 months.

What happens before inspection?What happens before inspection?

NB: Updated annually

What happens during inspection?

ETI:•ETI team to include reporting/deputy reporting inspector•Associate assessors, if required

Organisation:•BoG/M’c representatives •Senior management•Tutors, staff, participants & employers

DEL•Representative attends report back

Inspection Team

The number of inspection days varies depending on the size and scale of the project•Presentation by senior management•Observation of sessions •Scrutinise participants’ work/files/PTPs•Meetings with key personnel•Review of care, support and guidance •Visit workplace training, meet employers•Focus groups with learners•Daily report backs to manager

At the end of the inspection •Moderation meeting, •Report backs, DEL representative present

Baseline Inspection Visit

Aim: To evaluate and baseline current practice to inform their interim QIP

• To provide a clear indication to the project as to what they need to do to enhance the overall quality of provision

Will result in:

• Spoken report back of main findings for the organisation overall

• Written SOKF

Inspection Visit

Aim: To evaluate impact , outcomes and to inform future developments

Will result in:

• Spoken report back of main findings for the organisation overall

• Written SOKF

• One of six performance levels used for each of the three key questions

• Overall effectiveness paragraph.

WHAIWHAI

For ESF projects after their second visit

• Organisation (and DEL) receive a pre-publication copy of the report for factual accuracy check

• The RI considers any factual errors identified, and if necessary, discuss these with the organisation, making any required adjustments to the report prior to publication

• Report publishes on the ETI website, normally within 30 days of oral report back

If safeguarding is evaluated as unsatisfactory

• Safeguarding areas for improvement

followed-up by the ETI within 6 working

weeks

• Short letter publishes on the ETI website

Questions