Commission on Teacher Credentialing Ensuring Educator Excellence Program Assessment Technical...

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing

Ensuring Educator Excellence

Program Assessment Program Assessment Technical AssistanceTechnical Assistance

VioletViolet and and IndigoIndigo Cohorts CohortsSeptember 2010September 2010

11

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


AgendaAgenda Review Accreditation CycleReview Accreditation Cycle IPR versus PAIPR versus PA Program Assessment DocumentProgram Assessment Document New and Transitioning ProgramsNew and Transitioning Programs Relationship to Site VisitRelationship to Site Visit Submission, Review/Feedback, and Submission, Review/Feedback, and

ResubmissionResubmission Guidelines for SubmissionGuidelines for Submission Technology TipsTechnology Tips

22

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Review of Accreditation CycleReview of Accreditation Cycle

33

Biennial Report

Data Collecting

Biennial Report

Follow up to site visit

Site Visit

Biennial Report

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Review of Accreditation CycleReview of Accreditation Cycle

Biennial Reports

are programs effective in preparing competent educators?

are programs aligned with standards?

Site Visit

Program Assessment

are Common Standards and Program Standards implemented in an integrated, effective manner?

44

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


IPR versus PAIPR versus PA

Initial Program Approval documentInitial Program Approval document– The DreamThe Dream

Program Assessment DocumentProgram Assessment Document– The RealityThe Reality

55HO # 1 IPR-PA

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Purpose of Program Purpose of Program Assessment DocumentAssessment Document

Year 4 of accreditation cycleYear 4 of accreditation cycle Purposes:Purposes:

– To determine To determine ifif and and howhow programs programs are aligned are aligned with with program standardsprogram standards

– To To understand the data understand the data reported on in reported on in Year 3 Year 3 Biennial Report Biennial Report andand comment if appropriate comment if appropriate

– To aid in To aid in focusing the Site Visit focusing the Site Visit that will follow that will follow in Year Sixin Year Six

66

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment DocumentProgram Assessment Document Part I – Narrative response to standardsPart I – Narrative response to standards Part II – Supporting Documentation (syllabi Part II – Supporting Documentation (syllabi

or course of study )or course of study ) Part III – Assessments (assessment tools Part III – Assessments (assessment tools

reported on in the biennial report and reported on in the biennial report and supporting documentation)supporting documentation)

Summary Summary

77

New this year!

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document Part IPart I

Institution response to Institution response to Program StandardsProgram Standards

Describes Describes HOWHOW the program meets the program meets eacheach of the adopted program standardsof the adopted program standards

88

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document Part I – Part I – Describing the HOWDescribing the HOW

Begin by understanding the entire Begin by understanding the entire standardstandard

Take the standard apart sentence by Take the standard apart sentence by sentence (chunk by chunk)sentence (chunk by chunk)

Respond to Respond to eacheach part of the standard part of the standard Provide appropriate documentationProvide appropriate documentation

99

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Respond to key Respond to key verbsverbs or or phrases phrases from from each sentence of the standardeach sentence of the standard– The program The program provides…provides…

– The program The program prepares candidates to…prepares candidates to…

– Candidates have Candidates have multiple, systematic multiple, systematic opportunities to…opportunities to…

– Candidates are Candidates are required to demonstrate…required to demonstrate…


1010

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Consider what types of documentation will Consider what types of documentation will support your claimssupport your claims– Example: If the “program provides” what might Example: If the “program provides” what might

be in the syllabus/course of study to indicate be in the syllabus/course of study to indicate HOW this is accomplished?HOW this is accomplished?

Course topicCourse topic

Key ReadingsKey Readings

Pacing guidePacing guide

Other?Other?


1111

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Practice by reviewing some current Practice by reviewing some current program standardsprogram standards– Take standard apartTake standard apart– Verbs and phrasesVerbs and phrases– Types of documentationTypes of documentation


1212HO # 2 Sample Stds

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Any questions about Any questions about Part IPart I??

Any ideas to share with others?Any ideas to share with others?


1313

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document Part II - DocumentationPart II - Documentation

Course Syllabi, description of the course of Course Syllabi, description of the course of study, or other documentation to support study, or other documentation to support Part IPart I

No Vitae requiredNo Vitae required

1414

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document Part II - Part II - DocumentationDocumentation

If your institution uses a particular form as If your institution uses a particular form as a template or course outline that is a template or course outline that is required required as the core of as the core of each courseeach course::– You may submit You may submit one course outline one course outline in your PA in your PA

document.document.

If instructors designs their section of the If instructors designs their section of the course on their own:course on their own:– Include Include eacheach course syllabi for course syllabi for allall courses courses

taught in the two years prior to PA.taught in the two years prior to PA.

1515

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document Part II - DocumentationPart II - Documentation

Any questions about Any questions about Part IIPart II??


1616

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments

Provide the Provide the actualactual assessments reported assessments reported on in Biennial Report—template or sampleon in Biennial Report—template or sample– RubricsRubrics

– Observation formsObservation forms

– Portfolio guidelinesPortfolio guidelines

Provide Provide detailed information detailed information on on assessmentsassessments

Readers will have copies of Biennial Readers will have copies of Biennial ReportsReports

1717

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



Description of rubric points Description of rubric points Describe how you ensure that assessment Describe how you ensure that assessment

measures are used in the same manner measures are used in the same manner regardless of location, number of faculty, regardless of location, number of faculty, etc.etc.

Does the range of assessments address all Does the range of assessments address all candidate competencies? candidate competencies?

1818

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



MS/SS Programs MS/SS Programs do not do not need to include need to include information on TPA modelinformation on TPA model

MS/SS Programs MS/SS Programs dodo need to include need to include information oninformation on– Assessor trainingAssessor training

– Rescoring procedures Rescoring procedures

– Information that connects with Standards Information that connects with Standards 17,18,19 17,18,19

1919

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



Induction Programs Induction Programs do not do not need to include need to include FACT or FAS FormsFACT or FAS Forms

Induction Programs Induction Programs dodo need to include need to include information oninformation on– SP trainingSP training– Expectations and pacing of formative Expectations and pacing of formative

assessmentassessment– Information that connects with Standards 5 Information that connects with Standards 5

and 6 and 6

2020

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



PA Readers will use the PA Readers will use the Biennial Report Biennial Report and the and the CTC Feedback CTC Feedback in conjunction with in conjunction with the the program narrative program narrative and the and the assessment assessment toolstools– Provide feedback as to the type of assessments Provide feedback as to the type of assessments

used by the programused by the program

– Comment if the data does not indicate the Comment if the data does not indicate the program is meeting standardsprogram is meeting standards

2121

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



Any questions about Any questions about Part IIIPart III??


2222

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Document Program Assessment Document SummarySummary

Document compiled from the program Document compiled from the program narrative describing structure of the narrative describing structure of the program with respect toprogram with respect to– Program DesignProgram Design

– Course of Study (Curriculum and Field Course of Study (Curriculum and Field Experience)Experience)

– Candidate CompetenceCandidate Competence

2323HO # 3

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


New &Transitioning DocumentsNew &Transitioning Documents

Programs that have been through Initial Programs that have been through Initial Program Review within the Program Review within the last 12 months last 12 months do not do not need to go through PA.need to go through PA.

During TransitionDuring Transition– Institutions have options for responding to PA. Institutions have options for responding to PA.

These options will be noted as new standards These options will be noted as new standards are approvedare approved

– Program should be Program should be operating for 6-12 months operating for 6-12 months before the PA document is submitted – this is before the PA document is submitted – this is not not a pass on PA.a pass on PA.

2424

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Reading Certificate and Specialist (2010)Reading Certificate and Specialist (2010)

Education Specialist (2008-09)Education Specialist (2008-09)

MS/SS Clear (2009)MS/SS Clear (2009)

Career Technical Education (2008)Career Technical Education (2008)

School Nurse (2008)School Nurse (2008)

Bilingual Authorization (2008)Bilingual Authorization (2008)

MayMay not be required to do Program Assessment not be required to do Program Assessment

New &Transitioning DocumentsNew &Transitioning DocumentsTransitioning StandardsTransitioning Standards

2525

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Relationship to Site VisitRelationship to Site VisitPrior to Site VisitPrior to Site Visit

Results of Program Assessment guide Results of Program Assessment guide selection of site team membersselection of site team members

The program summary introduces the site The program summary introduces the site visit team members to the programsvisit team members to the programs

Preliminary Report of Findings, questions Preliminary Report of Findings, questions and concerns are reviewed by the teamand concerns are reviewed by the team

2626

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Relationship to Site VisitRelationship to Site VisitAt the Site VisitAt the Site Visit

Results are confirmed, particularly through Results are confirmed, particularly through interviewsinterviews

Team focuses onTeam focuses on– Program DesignProgram Design– Course of Study (Curriculum and Field Course of Study (Curriculum and Field

Experience)Experience)– Candidate CompetenceCandidate Competence

Inconsistencies with Preliminary Report of Inconsistencies with Preliminary Report of Findings may need additional reviewFindings may need additional review

2727

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Relationship to Site VisitRelationship to Site Visit

Preliminary Report of Findings deems Preliminary Report of Findings deems standards to be standards to be PreliminarilyPreliminarily Aligned Aligned

PA readers may identify PA readers may identify specific evidence specific evidence to beto be reviewed at the site visit reviewed at the site visit

Only the Site Visit Team Only the Site Visit Team can deem the can deem the standards to be standards to be metmet..

2828

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Relationship to Site VisitRelationship to Site Visit

Work to get all program standards aligned.Work to get all program standards aligned. Finalize the Program Narrative by Finalize the Program Narrative by

incorporating all edits/modifications into incorporating all edits/modifications into the narrative.the narrative.

Keep the narrative up to date.Keep the narrative up to date.

2929

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Submission, Review/Feedback, Submission, Review/Feedback, & Resubmission & Resubmission - Submission- Submission

All programs in the All programs in the violetviolet cohort cohort should should have already submitted have already submitted the “Proposed the “Proposed Submission Dates for all Programs” formSubmission Dates for all Programs” form– Informs the Commission of the dates PA Informs the Commission of the dates PA

documents will be submitted (October, documents will be submitted (October, November or December 15, 2010)November or December 15, 2010)

IndigoIndigo cohort will receive a letter early in cohort will receive a letter early in 2011 2011 requesting this form to be filled out.requesting this form to be filled out.

3030

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Submission, Review/Feedback, & Submission, Review/Feedback, & Resubmission Resubmission - Submission- Submission

Options for submissionOptions for submission– Email as attachments to Email as attachments to

[email protected] must be must be less than less than 10MB 10MB – – NONO zipped files. zipped files.

– Post on a website & Post on a website & provide an email provide an email with with instructions for review and download. instructions for review and download. Once Once documents are downloaded from this website they documents are downloaded from this website they should retain all hyperlinks.should retain all hyperlinks.

– 1 CD/Flashdrive with all parts mailed in.1 CD/Flashdrive with all parts mailed in.

A confirmation will be sent when documents A confirmation will be sent when documents are receivedare received

3131

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Submission, Review/Feedback, Submission, Review/Feedback, & Resubmission & Resubmission - Submission- Submission

ChooseChoose submission date wisely submission date wisely Documents will be read in order received Documents will be read in order received

whenever possible based on reader’s whenever possible based on reader’s expertise at each session.expertise at each session.

Indigo cohort Indigo cohort STRONGLYSTRONGLY encouraged to encouraged to serve as a PA reader in 2010-2011.serve as a PA reader in 2010-2011.

3232

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Submission, Review/Feedback, Submission, Review/Feedback, & Resubmission & Resubmission – Review/Feedback– Review/Feedback

Two trained readers per documentTwo trained readers per document Calibration of readers prior to reading first Calibration of readers prior to reading first

documentdocument Each document is initially read during the Each document is initially read during the

meetingmeeting Readers reviewReaders review

– Is the HOW described?Is the HOW described?

– Does the HOW meet the standard?Does the HOW meet the standard?

– Is there adequate supporting documentation?Is there adequate supporting documentation?

3333HO # 4

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Preliminary Report of Findings (PRF) Preliminary Report of Findings (PRF) feedback will be eitherfeedback will be either– Preliminarily AlignedPreliminarily Aligned– More information NeededMore information Needed

Feedback for 1Feedback for 1stst round will be in round will be in blueblue. . – Subsequent rounds of feedback (if necessary) will show Subsequent rounds of feedback (if necessary) will show

all of the previous feedback and new comments and all of the previous feedback and new comments and standard status will be shown in a new color:standard status will be shown in a new color:

22ndnd round – round – Green Green 33rdrd round – round – PurplePurple 44thth round - round - OrangeOrange

Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Review/Feedback– Review/Feedback

3434HO # 5

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Resubmissions due within 30 days.Resubmissions due within 30 days. First reading opens dialogue with program First reading opens dialogue with program

that could last for 12-15 months.that could last for 12-15 months. Examples of feedback:Examples of feedback:

– Possible CommentsPossible Comments Specifics of HOW the standard is addressed are neededSpecifics of HOW the standard is addressed are needed

The narrative response needs to reflect the standardThe narrative response needs to reflect the standard

The documentation does not support the narrativeThe documentation does not support the narrative

Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Review/Feedback– Review/Feedback

3535

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Resubmission– Resubmission

Submit additional information Submit additional information within 1 within 1 monthmonth or less. or less.– Inform PA staff if additional time is neededInform PA staff if additional time is needed

– Respond quickly while the document is fresh in Respond quickly while the document is fresh in the reader’s mindsthe reader’s minds

Amend Amend original document original document for resubmissionfor resubmission Use a Use a new font color new font color to indicate requested to indicate requested

additional information addedadditional information added

3636

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Resubmission– Resubmission

Amend the table of contents and Amend the table of contents and be sure be sure hyperlinks are accuratehyperlinks are accurate

Submit resubmission via email or on cd/flash Submit resubmission via email or on cd/flash drivedrive

Develop a process to continually update Develop a process to continually update program documents. – See program documents. – See PSA 10-12

Continuous review and update of the Continuous review and update of the document will save programs from having to document will save programs from having to write it all in preparation for Year 4 of the write it all in preparation for Year 4 of the cycle.cycle.

3737

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Guidelines for SubmissionGuidelines for Submission Preferred submission for part I, II, and III is a Preferred submission for part I, II, and III is a

singlesingle PDF document with a detailed PDF document with a detailed table of table of contentscontents for all parts and for all parts and hyperlinkshyperlinks..

Multiple files are cumbersome for readers to Multiple files are cumbersome for readers to switch between, and this should be avoided if switch between, and this should be avoided if possible.possible.

NO Paper – 100% Electronic SubmissionNO Paper – 100% Electronic Submission Submit documents on time – inform Submit documents on time – inform

[email protected] if they will [email protected] if they will be latebe late

3838HO # 6 & HO # 7

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Guidelines for SubmissionGuidelines for Submission Submission package (3 Pieces)Submission package (3 Pieces)

– 1 document containing parts I, II, and III –PDF1 document containing parts I, II, and III –PDF

– 1 word document containing summary – no 1 word document containing summary – no more than 4 pagesmore than 4 pages

Save Word documents 97-2003 compatibleSave Word documents 97-2003 compatible

– Submission checklist – use a separate checklist Submission checklist – use a separate checklist for each submission (program area)for each submission (program area)

Each program area package should be Each program area package should be sent in a separate email /CD/Flash Drivesent in a separate email /CD/Flash Drive

3939HO # 8

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Technology TipsTechnology Tips Search the internet for tips on hyperlinks Search the internet for tips on hyperlinks

and table of contentsand table of contents Use page numbers Use page numbers If possible refrain from linking to a website If possible refrain from linking to a website

– internet is not always available to – internet is not always available to readersreaders

Make sure you are not linking to a local Make sure you are not linking to a local document (another reason for 1 single document (another reason for 1 single document)document)

4040

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Technology TipsTechnology Tips How do I create hyperlinks to locations within How do I create hyperlinks to locations within

the same document? the same document? http://support.microsoft.com/kb/291182http://support.microsoft.com/kb/291182

Microsoft Word tutorial – Table of Contents I – Microsoft Word tutorial – Table of Contents I – Basic Table of Contents Basic Table of Contents http://office.microsoft.com/en-us/word-help/overview-RZ001135702.aspx?section=1http://office.microsoft.com/en-us/word-help/overview-RZ001135702.aspx?section=1

Microsoft Word tutorial – Table of Contents II – Microsoft Word tutorial – Table of Contents II – Advanced Table of Contents Advanced Table of Contents http://office.microsoft.com/en-us/word-http://office.microsoft.com/en-us/word-

help/table-of-contents-ii-advanced-tocs-long-documents-and-other-tables-RZ001152580.aspxhelp/table-of-contents-ii-advanced-tocs-long-documents-and-other-tables-RZ001152580.aspx

Creating a Table of Contents and adding Creating a Table of Contents and adding Bookmarks in Word Bookmarks in Word http://www.stanford.edu/group/step/new-step-website/resources/techclub/TOCnBkmk.htmhttp://www.stanford.edu/group/step/new-step-website/resources/techclub/TOCnBkmk.htm

4141

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


ResourcesResources Program Assessment webpageProgram Assessment webpage PSA 10-12 Maintaining a current program PSA 10-12 Maintaining a current program

document and responding to document document and responding to document feedbackfeedback

PSA 10-13 Update on Program PSA 10-13 Update on Program Assessment: Program SummaryAssessment: Program Summary

Tips for the preparation of program Tips for the preparation of program assessment documentsassessment documents

Contact: [email protected]: [email protected]

4242

Commission on Teacher Credentialing Ensuring Educator Excellence Program Assessment Technical...

Documents

Transcript of Commission on Teacher Credentialing Ensuring Educator Excellence Program Assessment Technical...