Karen E. S. PhillipsKaren E. S. PhillipsDirector of Pre-Health ProgramsDirector of Pre-Health Programs

Organic Chemistry InstructorOrganic Chemistry Instructor

Office of the ProvostOffice of the Provost

Tech Thursday PresentationsTech Thursday PresentationsPeer assessment and peer reviewPeer assessment and peer review

March 8, 2012March 8, 2012

A Peer Assessed Group Presentation A Peer Assessed Group Presentation Assignment in Organic ChemistryAssignment in Organic Chemistry

The ContextThe Context

• Undergraduate Organic Chemistry classUndergraduate Organic Chemistry class

• Mostly juniors, seniors & post-baccalaureatesMostly juniors, seniors & post-baccalaureates

•Pre-medical/dental/veterinary & PhD-boundPre-medical/dental/veterinary & PhD-bound

• 22ndnd Semester – More advanced concepts Semester – More advanced concepts

• 80 – 150 Students80 – 150 Students

• Pre-Established culture of group work & presentationPre-Established culture of group work & presentation

Rationale for ExerciseRationale for Exercise

• Encourages teamwork Encourages teamwork

• Exposes students to research using primary literatureExposes students to research using primary literature

• Familiarizes students with PowerPoint, ChemDraw etc. Familiarizes students with PowerPoint, ChemDraw etc.

• Provides exposure to teaching and public presentationProvides exposure to teaching and public presentation

• Simulates skills relevant to jobs in science Simulates skills relevant to jobs in science

• Introduces students to peer assessmentIntroduces students to peer assessment

• Enables me to learn what piques students’ interestEnables me to learn what piques students’ interest

Sample TopicsSample Topics

The Nitty-GrittyThe Nitty-Gritty• 4 – 6 Students per group4 – 6 Students per group

• 10 – 12 Minutes per presentation10 – 12 Minutes per presentation

• Equivalent score can replace midterm exam gradeEquivalent score can replace midterm exam grade

• All group members receive same scoreAll group members receive same score

• Group members responsible for division of laborGroup members responsible for division of labor

• Participation in peer assessment requiredParticipation in peer assessment required

• Must include prescribed elementsMust include prescribed elements

• Emphasis on chemistry essentialEmphasis on chemistry essential

• Criteria for peer assessment providedCriteria for peer assessment provided

Presentation Grading RubricPresentation Grading Rubric

The ProblemThe Problem

• Students grade every presentation except their ownStudents grade every presentation except their own

• Class of 80 Class of 80 16 Groups 16 Groups 1200 Grade Sheets 1200 Grade Sheets

• Class of 150 Class of 150 25 Groups 25 Groups 3750 Grade Sheets 3750 Grade Sheets

• Waste of paper to print grade sheetsWaste of paper to print grade sheets

• Waste of time to transcribe resultsWaste of time to transcribe results

Clickers to the Rescue!Clickers to the Rescue!

Instant Capture of Instant Capture of Peer Assessment DataPeer Assessment Data

Rubric Items Entered in CPSRubric Items Entered in CPS

The Setup for Peer AssessmentThe Setup for Peer Assessment

Instant Instructor FeedbackInstant Instructor Feedback

Generating ReportsGenerating Reports

Generating ReportsGenerating Reports

Sample ReportSample Report

Issues & PrecautionsIssues & Precautions

• Clicker numbers assignedClicker numbers assigned• Anomalous scores discardedAnomalous scores discarded• Instructor grade comparisonInstructor grade comparison• Group feedback – Average scores for each Group feedback – Average scores for each

category & percent totalcategory & percent total

Measures of SuccessMeasures of Success

• Class participation - 132/136 students - 97% Class participation - 132/136 students - 97%

• Grade ranges 88 – 99%Grade ranges 88 – 99%

• Survey results – overwhelmingly positiveSurvey results – overwhelmingly positive

• Lasting impressionLasting impression

• Educated ConsumersEducated Consumers

AcknowledgementsAcknowledgements

FITT Award – 2009FITT Award – 2009

Gina CherryGina Cherry