Curriculum Inventory Administrators’ Group December 9, 2015 Terri Cameron, MA, Director,...

Curriculum Inventory Administrators’ GroupDecember 9, 2015

Terri Cameron, MA, Director, Curriculum Programs

Audio: You will hear the audio through your computer speakers.

Please make sure your computer speakers are on and the sound is turned up.

If you still have no sound once the webinar starts, please click on the audio broadcast icon ( ) located in the Participants Panel on the right hand side of your screen.

Housekeeping

Please use the Q&A panel located on the right hand side of your screen to submit your questions throughout the webinar. Send to All Panelists.

If you experience any technical or audio issues during the webinar, please send a message through the Chat panel to AAMC Meetings.

Questions:

Please use the Chat panel located on the right hand side of your screen to submit your questions. Send to All Panelists.

Questions

• CI 2014-2015 Upload Statistics• December CI in Context• Updated CI Standardized Vocabulary• Curriculum Structure Survey?• Featured Report: Assessment of Professional Behavior• Curriculum Inventory Report Usage Statistics• Curriculum Inventory Report Template (New and Improved)• CI at 2016 Medical Education Meetings• Medical School Highlight: Vanderbilt University School of Medicine

• Anderson Spickart, III, Assistant Dean of Educational Informatics and Technology

• Next meeting: Wednesday, December 13, 1 pm ET

Agenda

CI 2014-2015 Upload Statistics• As of October 31 (final):

• Verified: 135• US MD: 127• CA MD: 5• US DO: 3

Acad Lev

# Schools 0-6 7-12 13-18 19-24 >24

1 135 4 120 8 2 12 127 4 109 11 2 13 112 3 81 27 0 14 90 5 68 13 2 25 2 0 2 0 0 06 2 0 2 0 0 0

Academic Level Distribution by Length (Month Increments)

CI 2014-2015 Upload Statistics

SB Location Academic Level

# Schools Reporting Min SBs Max SBs Avg SBs

Clerkship All 98 1 200 23Clerkship 1 5 1 2 1Clerkship 2 6 6 11 8Clerkship 3 91 1 54 9Clerkship 4 64 1 193 21Clerkship 5 2 1 7 4Clerkship 6 2 1 3 2PreClerkship All 134 1 228 31

PreClerkship 1 134 1 50 13



Sequence Block Summary

CI 2014-2015 Upload StatisticsEvent Summary

Event Location

Event Type

Number of Schools

Reporting Events

Minimum Events

Maximum Events

Average Number of

Events

Clerkship ALL 95 6 6485 357Clerkship Non-

Assessment95 6 6485 357

PreClerkship ALL 134 1 16169 1115

PreClerkship Non-Assessment

134 1 16169 1115

CI in Context: December• Importance of Benchmarking

Reports for Curriculum Continuous Quality Improvement• Robert Noiva, PhD, and

Robin Rivest, MS, Oakland University William Beaumont School of Medicine

www.aamc.org/medaps

Curriculum Inventory Standardized Vocabulary Update

Curriculum Inventory Standardized Vocabulary Update• Independent Learning: Instructor-/ or mentor-guided learning activities to be

performed by the learner outside of formal educational settings (classroom, lab, clinic) (Bowen & Smith, 2010); Dedicated time on learner schedules to prepare for specific learning activities, e.g., case discussions, TBL, PBL, clinical activities, research project(s).Synonymous with/Includes: Independent Study; Self-Study, Homework Does not include: Self-Directed Learning

• Self-Directed Learning: Learners taking the initiative for their own learning: diagnosing needs, formulating goals, identifying resources, implementing appropriate activities, and evaluating outcomes (Garrison, 1997; Spencer & Jordan, 1999).Does not include: Independent Learning; Independent Study

Curriculum Structure Survey?• What is the curriculum structure at your school?

• Case-based• Organ System• Integrated• Presentation-Based• Systems-Based• Theme-Based

Featured CI Report: Assessment of Professional Behavior

Curriculum Inventory Reports are accessed over 1,250 times per month

• Accessed over 1,000 times in 2015Jan 2015 Feb 2015 Mar 2015 Apr 2015 May 2015 Jun 2015

202 102 149 92 84 70

Jul 2015 Aug 2015 Sep 2015 Oct 2015 Nov 2015 YTD Total83 79 99 57 38 1055

Curriculum Inventory Reports are accessed over 1,250 times per month

• Accessed 710 times in 2015Jan 2015 Feb 2015 Mar 2015 Apr 2015 May 2015 Jun 2015

43 43 51 57 116 74

Jul 2015 Aug 2015 Sep 2015 Oct 2015 Nov 2015 YTD Total55 51 57 51 112 710

Curriculum Inventory Report Request Template

Drop-down will include ONLY participating schools

Will be adding options to include data from:• All Schools• US MD• CA MD• US DO

CI at 2016 Medical Education Meetings• Upcoming deadlines:

• MedBiquitous Conference (May): Deadline December 15• Med Ed Meeting (September): Deadline December 21

• Not yet announced:• GIR• Learn Serve Lead

• Past deadlines:• AACOM• CCME• GEA Regional Meetings• IAMSE

22

Capturing Medical Student Performance Data to Guide Personal Learning Plans

Vanderbilt School of Medicine Anderson Spickard, III, MD, MS

Toufeeq Ahmed, MD, PhDKim Lomis, MD

Bonnie Miller, MD

Transforming IT infrastructure to support major curricular reforms. Tch Learn Med. In press, Jan 2016.

Competencies

ActivitiesExperiences

AssessmentsData Repository

Vanderbilt Healthcare Learning System

Reflective Summary Personal Learning Plan

Learning Objectives

Guided Self-Assessment

Student ViewePortfolio

• Artifacts • Assessments

Administrative ViewProgram Evaluation

Inter-departmental courses

Individualized

Vanderbilt Curriculum 2.0

First year Second year Third and fourth year

Continuity clinic

PC1 History and Physical Exam

PC1a-History Sub-optimal Entry AspirationalThoroughness of history

Not engaged. Not focused on patient interaction.

Performs part of a history or a basic history. Important information may be lacking, or may be overly inclusive.

Performs a reasonably complete history. Gathers necessary elements to arrive at a correct diagnosis or short differential diagnosis. May be overly inclusive.

Performs a complete history. No major information is missed; perhaps a few small details forgotten; may be overly inclusive.

Targeted and appropriate history, including pertinent positives and negatives. Thoroughly and efficiently elicits patient’s history.

Performs part of a history or a basic history. Important information may be lacking, or may be overly inclusive.

Organization of history

Disruptive when asking questions or entering the conversation.

Captures fragmented information without an intentional approach.

Disorganized approach, or heavily relies upon a template, but eventually captures pertinent information.

Some organization, with some reliance on template or notes. Misses some helpful information or broadly inclusive without focus.

Organized, linear approach to history taking; able to independently obtain sufficient data with minimal reliance on template or checklist.

Organized, linear, hypothesis-driven approach. Able to elicit all important aspects of HPI, medical history, current medications, family and social history.

Competencies





Learning Objectives





Assessments

Grades Self-assessments

Peer assessments

Faculty assessments

Allied health professionals

Patient notes

Assessments

GradesSelf-assessmentsPeer assessmentsFaculty assessmentsAllied health professional assessmentsPatient notes

Assessments

GradesSelf-assessmentsPeer assessmentsFaculty assessmentsAllied health professional assessmentsPatient notes

Automatic scoring of medical students’ notes to monitor learning in the workplace. Med Tch. 2014:36;68-72.

Competencies





Learning Objectives





Faculty Review Portfolio Coach

Joint ReviewReconcile any differences

in interpretation of the evidence

Student ePortfolio

Student ViewInformed self-assessment

Personal Career goals

Personal Learning Plan

Promotion Committee

Example

Student 1 Student 2Student 3Student 4Student 5

Competencies





Learning Objectives






Data Repository

First Semester PDx(PDx Instructors)

Mid-Clerkships(Master Clinical Teachers)

End-clerkship OSCE(Faculty Observers)

Developmental Progression

End-Clerkship Year Multi-station OSCE assessment

RIME Assessment

OberserverGatherer

ReporterIntepreter

Manager

0

10

20

30

40

50

60

Year 2

Year 2.5

17

29

55

8

17

31

51

11

Mid - year

Receptivity to feedback

Difficulty receiving….Is receptive to…

Acknowledeges perceptions of others…Actively seeks feedb…

Aspirational

0

10

20

30

40

50

60

70

Year 1

Year 2

0

21

70

9

0

00

50 50

0

Mid - year

Self-awareness

EntryIf probed, superficial….

If probed, independent review...Spontaneously evaluates…

Aspirational

0

10

20

30

40

50

60

70

80

90

Year 1

Year 2

1 1

87

12

0

00

53

46

1

% of Student-Portfolio coach pairs congruent on all 6 ACGME domain assessments when they met

Yr 1 early Yr 1 mid Yr 1 end Yr 2 early Yr 2 mid 0

10

20

30

40

50

60

70

80

90

Next - EPA assessments via mobile

Curriculum development for the workplace using Entrustable Professional Activities (EPAs). AMEE Guide No.99. Med Tch. Early online, July 14, 2015;1-20.

• Education Informatics Division of VUMC Informatics Center under the leadership of Dr. Toufeeq Ahmed

• School of Medicine under the leadership of Deans Bonnie Miller, Kim Lomis, and Amy Fleming

• Office of Educational Informatics and Technology under the management of Jeremy Elgin

Acknowledgements

“Best-of-breed” approachCourse

Management [Moodle]

Curriculum Management

[Moodle Plugin]

Competency based Assessment [Build]

Evaluation [Qualtrics]

Portfolio & Personalized Learning

Plans [Build]

Video Hosting [Zencoder/Self]

Forums/Discussions [FreeForm]

Mobile Data Collection Apps

[Build]

Central Help Desk [OS

Ticket]

VSTAR Platform

TechnologiesProject Based on Tech Stack Server

Learn Open Source PHP, MySQL, APC, MemCache, Apache2

RedHat VM

CurriculumMap Open Source PHP, MySQL RedHat VM

Help/ Support Center Open Source PHP, MySQL RedHat VM

Portfolio Home Grown ASP, .NET, JQuery Win Server VM

FreeForm Home Grown ASP, .NET, JQuery Win Server VM

Online Grading Home Grown PHP, Oracle RedHat VM

Outcomes Database Home Grown PHP, Jquery, Oracle RedHat VM

Qualtrics Vendor SaaS

Use ‘Chat’ to tell us what’s going on with you!Other updates from participants

Happy Holidays!• Thanks so much for all you have done and continue to do on a

daily basis to make the CI the success it is!• We look forward to continuing to improve and enhance our data

and reports in the coming year.• Have a wonderful and blessed 2016!

• Wednesday, January 13, 1 pm ET• (Second Wednesday of each month, 1 pm ET)• Registration Links for 2016 will be posted soon • Please send agenda items to [email protected]

Next meeting:

mailto:[email protected]

Curriculum Inventory Administrators’ Group December 9, 2015 Terri Cameron, MA, Director,...

Documents

Transcript of Curriculum Inventory Administrators’ Group December 9, 2015 Terri Cameron, MA, Director,...