SCCI Prioritisation Tool
description
Transcript of SCCI Prioritisation Tool
1
SCCI Prioritisation Tool
Prototype for Presentation to SCCI
Version: 0.3Date: 20th May 2014
2
Overview of the Tool
• Assesses items against shared criteria using consistent scores• Summed scores enable work items to be positioned along
dimensions of Expected Benefit and Ease of Delivery• Result is richer than a one dimensional list since it brings out
the business relevance of relative positions• The tool does not automate decision making, but supports
informed reflection and enables better decisions to be taken
Criteria: Expected Benefits
1. improve the safety of patients and/or service users2. help individuals understand the types of care available3. help individuals compare the quality of different providers4. help individuals avoid illness, or manage their care needs5. help individuals access services relevant to their care needs6. help individuals access their own care records7. improve accuracy, consistency or timeliness of care information8. improve communication across organisational, geographical and system
boundaries9. improve the monitoring of outcomes in the quality of care provided10. help commissioners reconcile service provided with that commissioned11. help commissioners monitor the performance of service providers and identify
potential cost savings or productivity gains12. help regulators monitor the performance of service providers and identify
patterns that indicate the need for further investigation.
3
Criteria: Ease of Delivery
1. firm budget commitment or confirmed that deliverable from existing budget2. generates revenue or savings that cover implementation costs or accepted that
investment need not be recouped3. technical aspects well understood by development organisation4. implementation will be within a context that is familiar and prepared5. implementation requires minimal change to existing IT supplier contracts6. development and implementation has a clear motivation contained within the
NHS Outcomes Framework7. established and receptive market or clear evidence of customer demand8. implementation requires minimal change to existing business processes9. development and implementation will be within an environment of good
relationships10. committed SRO, actively engaged in the relevant governance activities11. committed and experienced development manager is in place
4
Criteria
Criteria can be changed easily to accommodate shifts in strategic or political priorities but all active items will need to be reassessed against changed criteria, so a formal change control process needs to be put in place – does not need to be onerous.
5
6
Scoresheet for criteria relating to Expected Benefits
Criteria Descriptions:• Helping individuals to choose
care types• Helping Individuals to choose
providers…
• Helping care providers to have better information
• Helping regulators to monitor performance
Individual scores
Narrative explanation of scoring
Weighting of criteria could be added but probably not useful
Recording whether Statutory/SoS Requirement
Total Benefits score
Standard or Collection ID
7
Scoresheet for criteria relating to Ease of Delivery
Criteria Descriptions:• Sufficient budget is available• Appropriately skilled staff are
available…
• Significant business change is not required
• Commercial/contractual changes not required
• Technical aspects are familiar
Individual scores
Narrative explanation of scoring
Optional Weighting for criteria that could be added to the tool
Total Ease of Delivery score
Standard or Collection ID
Results of the Assessment
• By summing the individual scores for each standard or collection, we end up with two overall scores, one for benefits and one for ease of delivery.
8
• We also capture whether an item is a SoS or Statutory requirement and (where available) its RAG status
• We use these data to plot the position of the standard or collection on the SCCI Prioritisation Matrix.
Expected Benefits
Ease of Delivery
SoS Requirement?
Statutory Req?RAG Status
SCCI Prioritisation Matrix (Basic)
9
You can see at a glance which items are high benefit & easy to deliver (top right), high benefit but difficult (top left), low benefit but easy (bottom right) and low benefit & difficult (bottom left).
EASE OF DELIVERY
EXPE
CTED
BEN
EFIT
S
R00316
ISB1588
ISB0144
ISB1077ISB0108
ISB1516
R00216R00217R00013
R00067
SCCI2025SCCI2023
SCCI2022
SCCI 2018
SCCI 2019SCCI 2016
SCCI 2007
SCCI 0086
SCCI 2005
SCCI2004
SCCI 2003
SCCI 2002
SCCI Prioritisation Matrix
10
EASE OF DELIVERY
EXPE
CTED
BEN
EFIT
S
R00316
ISB1588
ISB0144
ISB1077ISB0108
ISB1516
R00216R00217R00013
R00067
SCCI2025SCCI2023
SCCI2022
SCCI 2018
SCCI 2019SCCI 2016
SCCI 2007
SCCI 0086
SCCI 2005
SCCI ID Title SCCI ID Title
R00316 Abortion Statistics SCCI2023 Census Ethnicity Codes - DSCN11/2008
ISB1588 Accident and Emergency Clinical Quality Indicators SCCI2022 Pathology Bounded Code List
ISB0144 Adjusted Referral to Treatment (RTT) Dataset SCCI2018 Care Planning
R00067 Adult Cardiac Surgery Audit SCCI2019 ODS GP Data Indicators
R00217 Advisory Committee on Clinical Excellence Awards (ACCEA) - Collection of non-ESR items SCCI2016 Hospital at Home
R00216 Advisory Committee on Clinical Excellence Awards (ACCEA) - Employer Based Awards Reports SCCI2007 Assuring Transformation - Learning Disabilities Survey
ISB1077 AIDC for Patient Identification SCCI0086 Information Governance Toolkit V12
ISB0108 AIDC: Automatic Identification and Data Capture SCCI2005 Consent Management
ISB1516 Ambulance Electronic Patient Report SCCI2004 Audit Log Data Definitions (Patient Privacy Breaches)
R00013 Annual Census of General Medical Practitioners SCCI2003 Medication Syntax
SCCI2025 Unique Device Identifier for Implants SCCI2002 Prescriber Identifier Standard
Ambulance EPR, Learning Disabilities Survey, Care Planning, A&E Quality Indicators, Medication Syntax and Adult Cardiac Surgery Audit all score high on the benefit dimension
Clinical excellence awards, Annual Census of GP and Pathology Bounded Code List were score 0 for benefit
SCCI2004
SCCI 2003
SCCI 2002
This group is identified as being more challenging than the others
SCCI Prioritisation Matrix (including RAG)
11
SCCI ID Title SCCI ID Title
R00316 Abortion Statistics SCCI2023 Census Ethnicity Codes - DSCN11/2008
ISB1588 Accident and Emergency Clinical Quality Indicators SCCI2022 Pathology Bounded Code List
ISB0144 Adjusted Referral to Treatment (RTT) Dataset SCCI2018 Care Planning
R00067 Adult Cardiac Surgery Audit SCCI2019 ODS GP Data Indicators
R00217 Advisory Committee on Clinical Excellence Awards (ACCEA) - Collection of non-ESR items SCCI2016 Hospital at Home
R00216 Advisory Committee on Clinical Excellence Awards (ACCEA) - Employer Based Awards Reports SCCI2007 Assuring Transformation - Learning Disabilities Survey
ISB1077 AIDC for Patient Identification SCCI0086 Information Governance Toolkit V12
ISB0108 AIDC: Automatic Identification and Data Capture SCCI2005 Consent Management
ISB1516 Ambulance Electronic Patient Report SCCI2004 Audit Log Data Definitions (Patient Privacy Breaches)
R00013 Annual Census of General Medical Practitioners SCCI2003 Medication Syntax
SCCI2025 Unique Device Identifier for Implants SCCI2002 Prescriber Identifier Standard
EASE OF DELIVERY
EXPE
CTED
BEN
EFIT
S
R00316
ISB1588
ISB0144
ISB1077ISB0108
ISB1516
R00216R00217R00013
R00067
SCCI2025SCCI2023
SCCI2022
SCCI 2018
SCCI 2019SCCI 2016
SCCI 2007
SCCI 0086
SCCI 2005
SCCI2004
SCCI 2003
SCCI 2002
12
SCCI ID Title SCCI ID Title
R00316 Abortion Statistics SCCI2023 Census Ethnicity Codes - DSCN11/2008
ISB1588 Accident and Emergency Clinical Quality Indicators SCCI2022 Pathology Bounded Code List
ISB0144 Adjusted Referral to Treatment (RTT) Dataset SCCI2018 Care Planning
R00067 Adult Cardiac Surgery Audit SCCI2019 ODS GP Data Indicators
R00217 Advisory Committee on Clinical Excellence Awards (ACCEA) - Collection of non-ESR items SCCI2016 Hospital at Home
R00216 Advisory Committee on Clinical Excellence Awards (ACCEA) - Employer Based Awards Reports SCCI2007 Assuring Transformation - Learning Disabilities Survey
ISB1077 AIDC for Patient Identification SCCI0086 Information Governance Toolkit V12
ISB0108 AIDC: Automatic Identification and Data Capture SCCI2005 Consent Management
ISB1516 Ambulance Electronic Patient Report SCCI2004 Audit Log Data Definitions (Patient Privacy Breaches)
R00013 Annual Census of General Medical Practitioners SCCI2003 Medication Syntax
SCCI2025 Unique Device Identifier for Implants SCCI2002 Prescriber Identifier Standard
EASE OF DELIVERY
EXPE
CTED
BEN
EFIT
S
R00316
ISB1588
ISB0144
ISB1077ISB0108
ISB1516
R00216R00217R00013
R00067
SCCI2025SCCI2023
SCCI2022
SCCI 2018
SCCI 2019SCCI 2016
SCCI 2007
SCCI 0086
SCCI 2005
SCCI2004
SCCI 2003
SCCI 2002
SoS Requirements
Statutory Requirement
SCCI Prioritisation Matrix (including RAG + SoS/Statutory)
13
Some Operational Considerations
• The tool needs to be used by people who understand standards and collections, the challenges required to develop and implement them and the business drivers that make them valuable. It cannot be given to administrative staff.
• The tool needs to be used within the context of a dialogue with the proponents and potential developers of the standards and collections. All parties need to understand the rationale behind the score and as far as possible to be in agreement about the score.
• There is no need to carry out a retrospective assessment of the total portfolio. Assessment should only be necessary for standards or collections that are actively consuming resources. Standards and collections will actively consume resources at the following points:– when a new standard or collection is proposed and under consideration– when a new standard or collection is being developed (including consultation and publication)– when a new standard or collection is being implemented– when an existing standard or collection is undergoing maintenance changes– when an existing standard or collection is being reviewed– when an existing standard or collection is being deprecated or retired
14
What assessors said during testing
• The criteria seem relevant and comprehensive and even if the Sponsor/SRO can’t assess all at the start, they are a useful indicator of aspiration.
• The criteria fit in with the people, process, technology expectations that SCCI want to see in requirements and the final specification.
• The tool is liked - allowing for a similar SME approach to the I2N process with a strong empirical emphasis.
• It can be difficult with historical items to ascertain whether criteria are met but that is because we have not asked the questions within the ISB or ROCR processes.
• You need to understand the context when assessing, so dialogue between assessors and business owner/proposer/technical teams is essential.
• The documents don’t always contain the information necessary to carry out an assessment – interpretation is required, so narrative explanations and dialogue are very important
• A reasonably good knowledge of the standard/collection is required to use the tool, which supports the idea that assessors should come from teams such as I2N and Dev Support.
• Assessors should work with the idea submitter to reach agreement on scores or clarify disagreements.
15
Questions for SCCI• Is this sort of tool close to what was expected / required?• If not, what needs to change?• If it is broadly right, are the criteria correct? Any additions or amendments?• Is the scoring scale (-1 to 1 at 0.1 increments) too fine-grained or is it OK?• Is the presentation clear and acceptable?
Next Steps• Make any required amendments• Agree roles (assessors)• Produce simple guide for assessors and to help communicate to all involved in SCCI
process, including submitters of ideas• Connect tool with master schedule and other relevant SCCI tools
16
Plan
Approval date of 4th June assumes that prototype is close to what SCCI needs and that SCCI is happy to approve it (subject to requested changes), i.e. does not require resubmission at June 25th SCCI meeting.