Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance...

38
Milestones and You Laura Edgar, EdD, CAE Vice President, Milestone Development

Transcript of Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance...

Page 1: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

Milestones and You

Laura Edgar, EdD, CAEVice President, Milestone Development

Page 2: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Full-time employee of ACGME

Disclosures

Page 3: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Milestones Background

• Milestones Structure

• Considerations for the Milestones in your program

• Milestones 2.0

Presentation Outline

Page 4: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Milestones Background4

Page 5: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Describe performance levels for skills, knowledge, and behaviors in the six competency domains.

• Provide a framework of observable behaviors and attributes associated with residents’ development as physicians.

• Used as one indicator of a program’s educational progress

Milestones: What?

Nasca, TJ et. Al. The Next Accreditation System. 2012.366:1051-1056

Page 6: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• What do they know?

• What can they do?

• How do they conduct themselves?

• Competencies must be in concert to demonstrate the competent graduate

Milestones – What?

Page 7: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Purposes and Implications

ACGME

• Accreditation – continuous quality improvement (CQI)

• Public Accountability – focus nationally on important competency outcomes

• Community of practice for evaluation and research, with focus on continuous improvement

Training Programs

• Framework for CCC• Guide curriculum development• More explicit expectations of trainees• Support better assessment• Enhanced opportunities for early

identification of under-performers

High Stakes

• Research ONLY

• Not intended for SMB use

Residents and Fellows

• Increased transparency of performance requirements

• Encourage informed self-assessment and self-directed learning

• Better feedback• Facilitate individualized learning plans

Milestones

Milestones are a Formative Assessment Framework

Page 8: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Articulate shared understanding of expectations

• Describe trajectory from a beginner in the specialty to

an exceptional resident or practitioner

• Organized under six domains of clinical competency

• Represent a subset of all sub-competencies

• Set aspirational goals of excellence

Key Points: Milestones

Page 9: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Milestones Structure9

Page 10: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Milestone Template

10

Page 11: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

11

Milestone Template –

Osteopathic Recognition

Page 12: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• 7 additional subcompetencies

• Evaluated in conjunction with the specialty specific milestones

• Only evaluated for Residents/Fellows in the Osteopathic Recognition Track

Osteopathic Recognition

Page 13: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Family Medicine (FM) Resident in the Osteopathic Recognition (OR) Track

• FM Patient Care 2: Cares for Patients with Chronic Conditions

• OR Patient Care 2: Examination, Diagnosis, and Treatment

• These can be evaluated simultaneously

• You may need to re-evaluate your assessment tools to ensure you are capturing appropriate Osteopathic principles

Osteopathic Recognition -

Example

Page 14: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Option to select “Not Yet Completed Level 1” or “Not

Yet Assessable”

Milestones are progressive over time. There is no prescribed speed at which

residents must complete a milestone set.

Page 15: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• An attempt to define an explicit, practical, relevant, and

manageable set of domains of clinical competence

• An attempt to describe levels of competency development

during training, leading to unsupervised practice of medicine

• A way to better inform trainees of the expectations of training

What the Milestones Are

Page 16: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Not everything a graduating resident needs to know

or be able to do

• Not a mandate for specific rotations or durations of

experience

• Not a replacement for regular assessment and

evaluation

What the Milestones are Not

Page 17: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Available resources: faculty time, evaluation forms

• Variations in engagement and attitudes within programs

• Learning curve: Evaluating, aggregating, and reporting become easier as you and your program become more familiar with the process

Milestones Considerations

17

Page 18: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• All programs within a specialty use the specialty’s milestones

• Programs will report semi-annually

• Milestone data will be reported to ACGME through direct entry into the Accreditation Data System (ADS)

Milestones: Reporting

Page 19: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Residents/Fellows should receive a report of their

Milestones ratings following CCC meetings

• Ideally, residents/fellows perform self-evaluations

beforehand

Feedback to Residents and

Fellows

Page 20: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Coming Soon

Milestones 2.0

Page 21: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

• Too much!

• Dissatisfaction with non-PC/MK

• More people want to participate

What have we learned?

Page 22: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

What changed?

Page 23: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

What changed?

Page 24: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Differences

Patient Care and Medical Knowledge have two options

outside of the levels:

• Not yet completed Level 1/Critical Deficiencies

• Not yet rotated/ Not yet assessable

Page 25: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Supplemental Guide

Examples for Levels 1-5

Assessment methods

Resources

Page 26: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Supplemental

Guide

Page 27: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Page 28: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Supplemental Guide

Review the Milestones and Supplemental guide with

your CCC

Your CCC should do a shared mental model exercise

Program’s expectations at each level

Assessment tool(s) you will use

Rotations each will be assessed

Page 29: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Page 30: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Where do I find...?

Page 31: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Page 32: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Page 33: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Page 34: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Page 35: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Assessment 101

Introduction to Milestones

Coming soon:

Milestones 2.0 webcasts

<10 minute webcast to explain 2.0 to faculty

Courses Available On Demand

Page 36: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Other Resources

Page 37: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Other Resources

Page 38: Milestones and You - AHME€¦ · Residents and Fellows •Increased transparency of performance requirements •Encourage informed self-assessment and self-directed learning •Better

©2019 ACGME

Milestones:

[email protected]

Laura Edgar

[email protected]

Here to help