Inter-Rater Reliability
-
Upload
drew-hoover -
Category
Documents
-
view
49 -
download
0
description
Transcript of Inter-Rater Reliability
![Page 1: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/1.jpg)
Inter-Rater Reliability
CHCCS
November 13th 2012
![Page 2: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/2.jpg)
Today’s Presenters
Cynthia Martin, Ed.D.Professional Development
ConsultantRegion 3
Paul MarshallProfessional Development
ConsultantRegion 5
![Page 3: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/3.jpg)
PHI DELTA KAPPA International Research Bulletin
“The most powerful influence on students’ learning is the quality of the teacher.”
http://www.pdkintl.org/research/rbulletins/resbul27.htm
Ksas5532.eduldogs.org
![Page 4: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/4.jpg)
Outcomes
• Explore resources
• Explore the Evaluation Process
• Explore the relationship between Evaluation and Supervision
• Provide opportunity to participate in inter-rater reliability activity
• Provide updated information about Standard VI
![Page 5: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/5.jpg)
Wikicentral.ncdpi.wikispaces.net
![Page 6: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/6.jpg)
Additional Resources:• http://ncees.ncdpi.wikispaces.net
![Page 7: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/7.jpg)
7
Educator Effectiveness Website
Email specific questions about educator effectiveness to:
[email protected] from Microsoft online gallery
![Page 8: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/8.jpg)
Reflecting on Data
What trends do you see with your district’s or school’s data?How can you use this data/trends as a leader?http://www.ncpublicschools.org/docs/recruitment/effectiveness/680.pdf
These data represent only a portion of the educators employed by this local education agency. Not all teachers were evaluated during the 2010-2011. If the number of individuals in a school is fewer than 5, then results are shown as a N/A.
![Page 9: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/9.jpg)
Evaluation & Supervision
Describe the relationship between principal supervision and evaluation.
![Page 10: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/10.jpg)
Inter Rater Reliability
• http://www.youtube.com/watch?v=U6lrnAZxjiQ
• How did we rate this lesson?
• Anonymously enter response using Poll Everywhere
![Page 11: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/11.jpg)
Polleverywhere
• Please take out your cell phones
• Text 22333 to 193788
• This will welcome you to this session
• Once there, please text the letter or number that corresponds to your intended response for each element
![Page 12: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/12.jpg)
Element A
![Page 13: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/13.jpg)
Element B
![Page 14: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/14.jpg)
Element C
![Page 15: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/15.jpg)
Element D
![Page 16: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/16.jpg)
Element E
![Page 17: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/17.jpg)
Element F
![Page 18: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/18.jpg)
Element G
![Page 19: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/19.jpg)
Element H
![Page 20: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/20.jpg)
Reflection Activity
How do you ensure that the behaviors in the classroom align with the rating of the behaviors?
Solutions
![Page 21: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/21.jpg)
Standards 6 and 8
Incorporating
student growth into
the NC Educator
Evaluation System
![Page 22: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/22.jpg)
SBE Policy on Standard 6
• The Department of Public Instruction will complete the sixth and eighth standard ratings after the results of the 2011 – 2012 testing program have been finalized and approved by the State Board of Education, and the EVAAS value-added scores have been calculated. This population should take place in late September 2012.
![Page 23: Inter-Rater Reliability](https://reader033.fdocuments.us/reader033/viewer/2022061618/56813085550346895d965f82/html5/thumbnails/23.jpg)
• What Questions do you have?