Coaching PDSA Cycles - Carnegie Foundation for the...

29
Coaching PDSA Cycles Alicia Grunow Co-Founder Improvement Collective Senior Fellow, Carnegie Foundation Melissa Chabran Associate, Carnegie Foundation Christina Dixon Associate, Carnegie Foundation Emma Parkerson Associate, Carnegie Foundation

Transcript of Coaching PDSA Cycles - Carnegie Foundation for the...

Page 1: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Coaching PDSA Cycles

Alicia Grunow Co-Founder Improvement Collective Senior Fellow, Carnegie Foundation

Melissa Chabran Associate, Carnegie Foundation

Christina Dixon Associate, Carnegie Foundation

Emma Parkerson Associate, Carnegie Foundation

Page 2: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Objectives

Understand how PDSAs fit into the larger improvement science context

Be able to assess the learning from a PDSA

Be able to determine next steps in building a team’s capacity to run PDSAs

2

Page 3: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

PDSA Expertise Development

3

(1) KNOW ABOUT PDSAs

(2) EXPERIENCE USING PDSAs

(3) COACH OTHERS PDSAS

(4) TEACH/ DESIGN TESTING

STRATEGY

(1) Create a TRIAD with at least 1 person that currently coaches (2) Introduce yourself (BRIEFLY) to your group

• One thing you hope you learn today

Page 4: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Agenda

Introduction to PDSAs in an improvement context

Practice PDSA coaching – Assessing PDSAs – Deciding where to focus – Setting up a coaching conversation

Tips and Tricks

4

Page 5: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Organize asnetworks

Learn throughdisciplined

inquiry

Embracemeasurement

Attend tovariability

Seethe system

Be problem-focused

and user-centered

CORE PRINCIPLES OFIMPROVEMENT

6

Page 6: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

6

Lesson Study

ROCI Datawise

Action Research

Forms of Disciplined Inquiry in Education

PLC Cycle

PDSA Cycle

Page 7: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

8

PLAN

DO STUDY

ACT

What specifically are we trying to accomplish?

What change might we make and why?

How will we know that a change is an improvement?

The Model for Improvement Associates for Process Improvement

Page 8: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Theory Informs Testing and in Turn Testing Refines Theory

Bennett and Provost 2015

PLAN

DO STUDY

ACT

Aim

Page 9: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Learning Your Way into Improvement

API 2013

Changes that result in an

improvement A P S D

A P S D

Develop a change

Test under varied conditions

Wide-Scale Tests of Change

Implement the Change

Hunches Theories

Ideas

Page 10: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Inquiry in Improvement Science

Prediction based test of change

The improvement aim disciplines the focus of inquiry

Paired with process and outcome data (as well as other improvement tools)

Flexible methodology that can be applied to varied practices and used at different sizes

Results in common evidence based practices (and theory of improvement)

11

Page 11: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Organize asnetworks

Learn throughdisciplined

inquiry

Embracet

Attend tovariability

Seethe system

Be problem-focused

and user-centered

CORE PRINCIPLES OFIMPROVEMENT

6

Problem

System Map

Step Step Step Step Step P D

S A

Page 12: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

13

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What can you build on? What would push work

forward?

What stance is most appropriate?

Coaching Improvement

Page 13: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

14

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What would push work forward?

What stance is most appropriate?

Coaching Improvement

Page 14: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

Articulating and Testing Hypotheses

@2009 API

PLAN • What’s your change? • What’s your prediction?

• Plan to conduct test

DO • Execute test • Collect data, document observations

STUDY • Compare results

to prediction • What did you

learn?

ACT • Next steps: Adapt, adopt, abandon

Making your theories,

assumptions and hypotheses

explicit

Revealing gaps in our

understanding

Page 15: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

16

WHERE to look

Page 16: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

PLAN

DO

STUDY

ACT

The PDSA Cycle ARTICULATION OF A CLEAR HYPOTHESIS -change -goal -predictions

WHERE to look

Page 17: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

18

Subject Matter Knowledge

Improvement Knowledge

Success!

Subject Matter Knowledge: Research and professional knowledge about the content of what you are improving

Improvement Knowledge: The interaction of the theories of systems, variation, knowledge, and psychology.

?

Subject Matter vs. Improvement

Page 18: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

PLAN

DO

STUDY

ACT

The PDSA Cycle ARTICULATION OF A CLEAR HYPOTHESIS -change -goal -predictions

DESIGN OF THE EXPERIMENT -Scale of test -Data collection

DOCUMENTATION OF LEARNING -Carry out -Record surprises -Compare predictions to what happened

REVISE INITIAL HYPOTHESIS -New learning and theory refinement -Next steps

WHERE to look

Page 19: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

20

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What would push work forward?

What stance is most appropriate?

Coaching Improvement

① Use the PDSA look-fors to assess two PDSAs ② Compare with your triad

Page 20: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

21

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What can you build on? What would push work

forward?

What stance is most appropriate?

Coaching Improvement

Page 21: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

22

Level of Engagement

DEFIANT ACTIVE / ENTHUSIASTIC

PASSIVE / COMPLIANT

ENGAGED / CURIOUS

Page 22: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

23

Developmental Trajectory

NOVICE EXPERT COMPETENT

Page 23: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

24

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What stance is most appropriate?

Coaching Improvement

① Choose ONE PDSA to work with as a triad ② Individually determine:

• One asset you would build on • One specific area in which you would focus

③ Share your rationale with your triad

What can you build on? What would push work

forward?

Page 24: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

25

Expertise Development

NOVICE EXPERT COMPETENT

Personally meaningful learning!

Predictions

Change ideas

Tests that build

Efficiency of testing Analysis

Quality change ideas

Rhythm (execution)

Page 25: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

26

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What would push work forward?

What stance is most appropriate?

Coaching Improvement

Page 26: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

27

Stances

Inquire (Asking)

Directive (Telling)

Facilitative (Guiding)

Accessing your own ignorance

Sharing your knowledge

Pulling out what they know; co-construct

“Making your predictions more

specific is going to help drive your learning.”

“Tell me about what you have

been learning...”

“Where’s your next opportunity

to test this?”

“It sounds like your hypothesis

is….“

Page 27: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

28

Coaching WHERE to look INTERPRET/ASSESS

what you see Decide what to

FOCUS on Decide coaching

STANCE

What’s important? What’s going well? What’s not?

What would push work forward?

What stance is most appropriate?

Coaching Improvement

You have a 30 minute conversation coming up with the team. You want to get to the next PDSA. ① How would you structure the

conversation? ② What stance(s) would you use in each

part? (Identify and possibly roll play specific questions.)

Page 28: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and

PLAN

DO

STUDY

ACT

The PDSA Cycle • Limited or vague predictions • Unspecific change idea

• Difficulty identifying opportunities to learn

• No data collection sheet

• Difficulty in abstracting from what happened in the test

Top 10 Common Breakdowns

• Report doing PDSAs but no documentation

Mad Libs

• Not strategic in testing • Learning that doesn’t “travel” • No routine for learning • Social settings that don’t support sense-making

Draw your theory

Facipulate PDSAs

3 pieces of paper

Coach as documenter

Coaching

Cross school PDSAs

Page 29: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and