Post on 02-Jan-2016
Agenda
• Overview of process• Balanced Score Card Development• Dataset requirements• Data Collection• Data Storage• Information Reporting• National Reporting• Risks and Clarifications• Feedback
Overview of Process 1
• Definition of the project objectives– “in 2 years time, how will we know what impact
the WISMS project has had on our Service Users, Service Providers, Staff and wider Community?”
– Where are we starting (the baseline)?– What is ‘better’?– 3 metrics per task-group
Overview of Process 2
• Convene 4 Task Groups each made up of a cross-section of stakeholders to define the metrics that would measure the impact across their areas:– Economic Benefit– Individual Health and Wellbeing– User Experience– Community
Balanced Scorecard Development
• Each Task Group workshops to define:– Definition – what is the individual metric?– Baseline or Comparator – Oct 1 2009 or similar control– Currency – Attendances / Service Users / Events /
Completions– Timescale – per day / week / month / quarter / year /
project– Validations – is the data accurate?
• Facilitated (but not constrained) by IM&T
Individual Health and Wellbeing metrics - Financial
• IHWB-F1 Number of Service Users asked about debt
• IHWB-F2 Number of Service Users identified as having debt problems
• IHWB-F3 Number of Service Users referred to Specialist debt counselling services
Individual Health and Wellbeing metrics - Personal
• IHWB-P1 Number of Service Users participating in 30 minutes of activity on 3 or more days per week
• IHWB-P2a Number of Service Users referred to smoking cessation clinics
• IHWB-P2b Number of Service Users attending smoking cessation clinics
• IHWB-P2c Number of Service Users confirmed as '4 week quitters'
Individual Health and Wellbeing metrics - Social
• IHWB-S1 Number of Service Users reporting positive relationships with family and carers
• IHWB-S2 Number of Service Users involved in community groups, activities and involvement
Individual Health and Wellbeing metrics - Qualitative
• IHWB-Q1 Average Score of All Services User responses to Questionnaire Q1 this quarter
• IHWB-Q2 Average Score of All Services User responses to Questionnaire Q2 this quarter
• IHWB-Q3 Average Score of All Services User responses to Questionnaire Q3 this quarter
• IHWB-Q4 Average Score of All Services User responses to Questionnaire Q4 this quarter
User Experience metrics – Personal Development
• UE-PD1 – No of Service Users / Village Project attending Harm Reduction per month
• UE-PD2 – No of Service Users / Village Project attending a Personal Support session each month
• UE-PD3 – No of Service Users / Village Project attending a Structured Day Programme
• UE-PD4 – No of Service Users engaged in Village Project
User Experience metrics – Professional Development
• UE-Prof1 – No of Service Users / Village Project attending College Training (courses) each month
• UE-Prof2 – No of Service Users / Village Project attending an internal /on-site Training (courses) session each month
• UE-Prof3 – No of Service Users / Village Project attending JC+ employment Training each month
User Experience metrics – Social Reintegration
• UE-SR1 - Number of Service Users / Village Project attending P2W each month
• UE-SR2 - Number of Service Users / Village Project attending JC+ Interviews each month
• UE-SR3 - Number of Service Users / Village Project becoming volunteers each month
• UE-SR4 - Number of Service Users / Village Project becoming employed each month
Community metrics
• Comm-1a - The number of Service Users with parental /
guardian responsibility accessing WISMS family support team
• Comm-1b - The number of Service Users with parental /
guardian responsibility accessing Mainstream Family Support
Services
• Comm-2 – The number of Service Users reporting an
improvement in accommodation status (1-5)
Community metrics
• Comm-3a - Community perception of levels of alcohol and
drug activity - Q1
• Comm-3b - Community perception of levels of alcohol and
drug activity - Q2
• Comm-3c - Community perception of levels of alcohol and
drug activity - Q3
Economic Benefit metrics
• EB1 - Reduction in the cost of crime
• EB2 - Reduction in the cost of A&E attendances
• EB3 – Reduction in the cost of Benefits paid
Dataset Requirements
• From the workshops and subsequent clarifications data would be required from:– NHS Secondary care data (A&E, Inpatient and
Outpatient)– DWP Benefits paid– Criminal Justice crimes data– Service User Quarterly reviews– Community questionnaires
Definition of ‘our cohort’
• What is the cohort of Service Users:– “Clients on Turning Point / CIM and SystmOne as
at 1 October 2009 aged 18 years on that date”– How often do we add / remove Service Users?
Data Collection and Reporting
Collection– Forms / Direct input (secure system)– SUS Data (PCT)– DWP (tba)– Criminal Justice (tba)
• Reporting– Balanced Scorecard / Dashboard– Individual Trends– National Reporting (SUS data)
Data Sharing
• Meetings have taken place with PCT Information Governance.
• All exchanges will take place under the Inter-Agency information Sharing Protocol. (Feb’09)
• ISA will underpin these.• Utilise Data protection Act 1998 – Caldicott Principles• Gold standard – Consent
Risks and Clarifications• Anonymisation of SUS data for this we will need • Ability to track individual Service Users throughout
the pathways? – Gold Standard – may not be able to achieve this. Silver standard basic of the BSC
• Information Sharing (all parties) &Co-operation by all participating organisations on data collection and communication
• Funding - may need up to 4 IT Servers• Workforce engagement and training• Additional data sources (future)-