TELPAS HOLISTIC RATER TRAINING
Transcript of TELPAS HOLISTIC RATER TRAINING
![Page 1: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/1.jpg)
2014-2015 Holistic RatingTraining Requirements
Texas Education AgencyStudent Assessment Division
![Page 2: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/2.jpg)
Disclaimer
TEA 2
These slides have been prepared by the Student Assessment Division of the TexasEducation Agency.
If any slide is amended or revised for local use, please remove the TEA footer at thebottom of the slide.
![Page 3: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/3.jpg)
Topics
TEA 3
TELPAS Raters
Credentials
Responsibilities
New & returning rater definitions
Holistic Rating Training
Overview
Training requirements
Basic training, calibration, and supplemental support
![Page 4: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/4.jpg)
Rater Credentials
TEA 4
Each teacher selected to rate an ELL must
1) have the student in class
2) be knowledgeable about the student’s ability
to use English in instructional and informal
settings
3) hold valid education credentials such as a
teacher certificate or permit
4) be appropriately trained, as required by TEA
![Page 5: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/5.jpg)
TELPAS Rater Responsibilities
TEA 5
A student’s TELPAS rater is the teacher
designated by the district as the official rater
of the student’s English language proficiency.
The student’s rater must rate the student in
all domains for which the student is eligible.
A student is not permitted to have one rater
for some domains and another rater for other
domains.
![Page 6: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/6.jpg)
New and Returning Rater Definitionsfor K–1 and 2–12
•The training webpage informs raters that districts may sometimes require a returning rater to complete new-rater training and to consult with their testing coordinator if they need clarification.
6TEA
![Page 7: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/7.jpg)
Holistic Rating Training
TEA 7
It is recommended that districts andcampuses determine in the fall who their TELPAS raters will be in the spring.
A training flowchart is provided on the next slide.
![Page 8: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/8.jpg)
Returning Raters
Online Basic Training Course
Online Calibration
(Sets 1 and 2*)
If not calibrated: Supplemental Holistic Rating Training
Final Online Calibration (Set 3)
Fall ELPS-TELPAS Foundational (Awareness) Training
For teachers who will be trained as new TELPAS raters in the spring if they lack this foundation
Spring TELPAS Administration Procedures Training
As a key part of this training, information from the TELPAS Rater Manual is reviewed to prepare
raters to proceed with online holistic rating training
Online Calibration
(Sets 1 and 2*)
New Raters
*Set 2 required only ifnot successful on Set 1 TEA 8
Training
![Page 9: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/9.jpg)
TELPASAdministration Procedures Training
TEA 9
As part of annual spring TELPAS administration procedures training, holistic rating training requirements are reviewed with raters, as well as information about how to access the online training and calibration components.
In addition, raters receive training on assessment procedures such as how to assemble writing collections, how to record students’ proficiency ratings, etc.
![Page 10: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/10.jpg)
Two Types of Training
TEA 10
Online basic training course
This course is for new raters. It providesinstruction on using the PLD rubrics and gives
raters practice rating students in each language
domain. There are separate courses for K–1 and
2–12.
Online calibrationThis is for all raters. Raters use the PLDs to rate
students in each language domain. Raters have
three opportunities to calibrate on assigned
grade cluster.
![Page 11: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/11.jpg)
Training and CalibrationGrade Clusters
TEA 11
Raters must know their assigned grade cluster to
select the appropriate online training.
Raters should consult with their campus testing
coordinator if they are unsure of their assigned
cluster.Grade Clusters
Grades K–1
Grade 2
Grades 3–5
Grades 6–8
Grades 9–12
![Page 12: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/12.jpg)
Raters with Students in MultipleGrade Clusters within Grades 2–12
TEA 12
Raters are required to train and calibrate in thecluster in which they have the most ELLs.
As a best practice, these raters should alsoreview online basic training course practiceactivities in the additional cluster(s).
Example: A grade 2–5 ESL teacher has most of her ELLs in grade 3. She must complete training and calibration in grades 3–5. As a best practice, she should review the online practice activities for grade 2 to check her readiness to apply the rubrics appropriately.
![Page 13: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/13.jpg)
Raters with Students in Multiple GradeClusters that Include Grades K–1
Because of differences in the instructional content andrating rubrics, these raters must complete training and calibration for K–1 and at least one other cluster in 2–12.
Raters with more than one additional cluster should trainin the cluster in which they have the most ELLs.
As a best practice, these raters should also review online basic training course practice activities in the additionalcluster(s).
TEA 13
Example: A grade 1–3 ESL teacher has most of his ELLs in grade 2. He must complete training and calibration in grades K–1 and 2. As a best practice, he should review the online practice activities for grades 3–5 to check his readiness to apply the rubrics appropriately for his 3rd grade students.
![Page 14: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/14.jpg)
When and where do raterstake the online training?
TEA 14
Depending on campus arrangements, raters mayeither complete training and calibration during schoolhours, after school, or on weekends.
The online training system allows raters to access the training from any computer that meets the minimumsystem requirements.
It is a violation of state assessment procedures to record, discuss, or share answers to the rating practice and calibration activities. Prior to accessing the online courses and calibration activities, raters are required to read an online statement and affirm that they will complete the rating activities independently.
![Page 15: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/15.jpg)
Why is calibration necessary?
TEA 15
Calibration helps ensure that raters have adequatetraining, including ample practice and feedback, before they assess their students in the spring.
Calibration ensures that raters clear their heads and consider only the elements of student performance included in the PLDs.
Calibration supports assessment validity andreliability and is an important part of holistically scored assessment processes.
![Page 16: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/16.jpg)
Preparing for Calibration Sets
TEA 16
New raters must complete the online basic training course before beginning calibration.
All raters have the option to review theonline basic training course (which includes practice rating activities) beforebeginning calibration.
![Page 17: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/17.jpg)
Other Things to KnowAbout Calibration
TEA 17
Raters affirm online that they will keep the contentsof the calibration sets secure and confidential.
Calibration activities are taken from a bank and randomized. Trainees will rate different sets of students.
Raters can work at their own pace, go back and review students, and change ratings as they work.
![Page 18: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/18.jpg)
Raters can exit and return later to finish. They click a“submit” button when they are finished with a set.
After completing a calibration set, raters immediatelysee results. Results show both the rating assigned bythe rater as well as the correct rating.
Raters see annotations explaining the correct ratings. Raters should use the annotations to go back and review any incorrectly rated students.
TEA 18
Other Things to Know About Calibration
![Page 19: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/19.jpg)
Is calibration a test?
No, it is a training method that ensures that raters have enough guidance, practice, and support to assess students consistently and accurately.
TEA 19
![Page 20: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/20.jpg)
Will raters be able to refer to any resources during calibration activities?
TEA 20
Yes, raters should use their rating rubrics (PLDs)
and refer to, as needed, information from the:
online basic training course
holistic rating PowerPoints produced by TEA
TELPAS Rater Manual
Educator Guide to TELPAS
After raters have completed calibration activities, they must destroy all notes taken about specific student profiles.
![Page 21: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/21.jpg)
How many students must be rated successfully?
To be successful, raters need to rate
students in their assigned grade cluster
with at least 70% accuracy.
TEA 21
![Page 22: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/22.jpg)
Supplemental Holistic Rating Training
TEA 22
Raters not successful after sets 1 and 2 must
receive supplemental training.
The rater will meet with a district-appointed
supplemental support provider.
After the rater has received supplemental training,
he or she will be able to access the third and final
calibration set.
![Page 23: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/23.jpg)
Recap of Calibration Process
TEA 23
There are 3 sets of 10 students.
Raters who calibrate on set 1 are done.
Raters who don’t calibrate on set 1 go on to set2. Raters who calibrate on set 2 are done.
Raters who don’t calibrate on set 2 receivesupplemental training.
Raters attempt third and final calibration set.
Raters who calibrate on set 3 are done.
![Page 24: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/24.jpg)
What happens if a rater is unsuccessful in calibrating?
TEA 24
Two outcomes are possible for individuals whocomplete the calibration activities but are notsuccessful:
The district may choose not to assign theindividual to be a TELPAS rater.
If the individual is needed to serve as a rater, thedistrict must implement rater support proceduresto ensure that the rater’s students are evaluatedconsistent with the rating rubrics.
Individuals are not authorized to serve as raters unless they
complete the required training components.
![Page 25: TELPAS HOLISTIC RATER TRAINING](https://reader034.fdocuments.us/reader034/viewer/2022052311/55af33161a28ab84028b4604/html5/thumbnails/25.jpg)
Raters who take the basic training course get acertificate from the online TrainingCenter aftercompleting the course components.
Raters will receive a certificate of successful
calibration when they calibrate.
TEA 25
Course and Calibration Certificates