A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting...
Transcript of A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting...
![Page 1: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/1.jpg)
A Deep Dive Into the Online Reporting Suite
(ORS) for Interim
Assessments
August 21, 2018
1
![Page 2: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/2.jpg)
Housekeeping
If you have problems hearing the presentation, dial in on a telephone. Dial-in information:
• in the Event Info tab at the top-left of the screen
• in your registration email ([email protected])
Dialing in for audio is recommended for best sound quality.
All attendees’ lines have been muted due to the high number of participants.
For questions or comments, use the “Q&A” function.
2
![Page 3: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/3.jpg)
ObjectivesToday’s session will cover the following topics:
• Reporting Overview
• Online Reporting Suite (ORS)
• Probability Scores
• Interim Data File
• Interpreting Results
3
![Page 4: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/4.jpg)
Reporting Overview
![Page 5: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/5.jpg)
Reporting
• New Online Reporting Suite (ORS)
• Dynamic, real-time reporting system
• District, campus, and student level
• User-friendly graphs and customization
• Filterable results
• Probability results reported in the STAAR Assessment Management
System
• District data file
5
![Page 6: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/6.jpg)
Reporting
Results Key
6
![Page 7: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/7.jpg)
Reporting
Results Key
7
![Page 8: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/8.jpg)
Reporting
How Results are Calculated
8
![Page 9: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/9.jpg)
Accountability
• Optional assessments
• NOT tied to accountability
9
![Page 10: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/10.jpg)
Online Reporting Suite (ORS)
![Page 11: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/11.jpg)
Online Reporting Suite (ORS)
• Dynamic real-time reporting
• Immediately after test submission, ORS will display the following results
• District
• Campus
• Student
• Results filterable by student demographics
• First release of results available beginning August 31, 2018
11
![Page 12: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/12.jpg)
Online Reporting Suite (ORS)
• Results available from the primary (first) completed attempt only
• Available immediately after test is completed
• Allow five minutes for processing
12
![Page 13: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/13.jpg)
Expanded Online Test Administrator & Teacher Roles
• For the interim assessment, the online test administrator and teacher roles have been expanded.
• The intent of expanding these roles is to give districts an option to allow educators to view their students’ results in ORS.
• Educators who are assigned these roles by the district in the Assessment Management System will be able to view interim results for all students within their campus in the Assessment Management System and ORS.
• See the User Roles & Permissions Matrix for details on each user role.
13
![Page 14: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/14.jpg)
Expanded Online Test Administrator & Teacher Roles
• Educators will have access to demographic information for students registered in their campus via Students > View & Edit on the Profile tab.
• Educators will be able to access the attempts history pop-up under the Manage Online Testing tab in the Assessment Management System.
• Allows user to view probability scores for all attempts
14
![Page 15: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/15.jpg)
Expanded Online Test Administrator & Teacher Roles
• Educators will NOT be able to view any STAAR data or view any student information beyond the campus level.
• No access to summative standard reports under Reports > Results in the Assessment Management System
• No access to the Scores tab in the individual student profile where STAAR Report Cards are posted
15
![Page 16: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/16.jpg)
Expanded Online Test Administrator & Teacher Roles
• Pursuant to the Family Educational Rights and Privacy Act (FERPA), the disclosure of personally identifiable information from education records is permissible without written consent of the parent or eligible student if the disclosure is to other school officials, including teachers, within the local education agency (LEA) whom the LEA has determined to have legitimate educational interests. Please note FERPA compliance is required when assigning roles to access the online reporting system.
16
![Page 17: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/17.jpg)
Navigation
• From the Assessment Management System, select Reports > Online Reporting from the top dropdown menu.
17
![Page 18: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/18.jpg)
Navigation
• From the Online Reporting Suite, select the Organization Reports tab to view organizational reports (district or campus).
18
![Page 19: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/19.jpg)
Navigation
• From the Online Reporting Suite, select the Student Reports tab to view student level reports.
19
![Page 20: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/20.jpg)
Navigation
• From the Online Reporting Suite, select Back to STAAR Assessment Management System from the top dropdown menu.
20
![Page 21: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/21.jpg)
Find Interim Report
• Opens at the user’s organizational level
• Users can then navigate to campus-level and student-level reports as permitted by their user role
• Users with multiple user roles can view all their organizations
• Use the Organization Reports and Student Report tabs to toggle between organization level and student level
21
![Page 22: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/22.jpg)
Find Interim Report
1. From the Assessment Management System, navigate to Reports > Online Reporting.
OR
2. Click the View Report icon on the Manage Session page.
The Find Interim Report appears, displaying the summary report at the user’s organizational level.
3. Select an Organization (if different from the organization displayed), Grade, and Subject.
4. Click the Find button.
5. Click a report link under Report Name to view.
22
![Page 23: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/23.jpg)
Find Interim Report
23
![Page 24: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/24.jpg)
Find Interim Report
• Available at district, campus, and student levels
• Summary view and expanded list views at each level
• Includes clickable graphics and other elements that expand on information
• View individual student reports at any time by using the Student Report tab
24
![Page 25: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/25.jpg)
District-Level Reports
• Campus results in a bar chart (lowest to highest mean score)
• District results in pie chart with aggregate results
• Segmented into campuses by the following criteria
• Top 25%
• Bottom 25%
• Middle 50%
• Click Students Tested button to view a list of all campuses with data.
• Organized lowest to highest mean score
• Number of students tested in grade and subject listed
25
![Page 26: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/26.jpg)
District-Level Reports
26
![Page 27: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/27.jpg)
Campus-Level Reports
• Open at summary report displaying:
• Student results in bar chart (lowest to highest mean)
• Campus pie chart with aggregate results
• Segmented into groups of students by the following criteria
Top 25%
Bottom 25%
Middle 50%
• Click Students Tested button to view a list of all students (listed alphabetically) with test results including the following:
• Score
• Probabilities
• Reporting Category Scores
27
![Page 28: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/28.jpg)
Campus-Level Reports
28
![Page 29: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/29.jpg)
Campus-Level Reports
29
![Page 30: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/30.jpg)
Student-Level Reports
• Allow educators to perform item analysis based on individual student performance
• Display the following:
• Overall score as a number and plotted on a scale
• Performance in each reporting category
• Approaches, Meets, and Masters probabilities
• TEKS student expectation for each test question
• Student’s response to each test question
• A pop-up window that shows the test question
30
![Page 31: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/31.jpg)
Student-Level Reports
• Click an Info icon in “Reporting Category Performance” section or a link in the “Student Expectation” column to review student expectation information and reporting categories for each question.
• Click the View icon to see the item, student response, and correct response.
31
![Page 32: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/32.jpg)
Student-Level Reports
32
![Page 33: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/33.jpg)
Probability Scores
![Page 34: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/34.jpg)
Probability Scores
• Assessment Management System will display probability results
• Available immediately after testing
• Located in the Manage Online Sessions page in the View Attempts icon
• Show percentage probability of achieving the following categories on STAAR
• Approaches
• Meets
• Masters
• Includes results from all testing attempts
34Copyright © 2018 by Educational Testing Service. All rights reserved. ETS, the ETS logo and MEASURING THE POWER OF LEARNING are registered trademarks of Educational Testing Service (ETS). 34728
![Page 35: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/35.jpg)
Probability Scores
1. From the top navigation bar in the Assessment Management System, select Online Testing, then Manage Online Testing.
2. Select an interim administration (“INT”).
3. Select a Subject, Testing Grade, and District or Campus.
4. Click the SEARCH button.
5. In the Groups in Session list, click the View icon next to the appropriate testing group.
6. Results will appear on the Student Attempt History pop-up.
35
![Page 36: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/36.jpg)
Probability Scores
Student Attempt History
36
![Page 37: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/37.jpg)
Interim Data File
![Page 38: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/38.jpg)
Interim Data File
• A preliminary data file will be available in early January.
• A final data file will be available two weeks after the test window closes.
• Available in the Assessment Management System from Reports > Results
• Process for downloading similar to summative
• Choose interim test administration (“INT”)
38
![Page 39: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/39.jpg)
Interim Data File
• Fixed-width data file
• Refer to Appendix B: Interim Data File Form for how to find and interpret information
• Includes the following:
• Student responses to test items
• Which Section 2 the student took (higher difficulty, medium difficulty, lower difficulty)
39
![Page 40: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/40.jpg)
Interpreting Results
![Page 41: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/41.jpg)
Interpreting ResultsHow should districts interpret results?
• Interim Assessments Results Guide will be posted this fall.
• https://tea.texas.gov/student.assessment/IA
• Provides information on interpreting each type of reporting information including:
1. Student’s Scale Score
2. Student’s Probability of Achieving Each Performance Level
3. Student’s Reporting Category Results
4. Student’s Performance on Each Item
• Provides sample remediation strategies
41
![Page 42: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/42.jpg)
Training
![Page 43: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/43.jpg)
Interim AssessmentsUpcoming Webinar Trainings
Starting early, get ready for online testing (interim and summative)
• New secure browser needed
• 7/23 Bi-Weekly Email
• Online Testing > Secure Browsers
• Thursday, August 23, 2018
• 1:00 p.m.–2:00 p.m. CT
Registration links posted to https://www.texasassessment.com/administrators/training
43
![Page 44: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/44.jpg)
Questions
44
![Page 45: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/45.jpg)
Questions?
45
![Page 46: A Deep Dive Into the Online Reporting Suite (ORS)€¦ · A Deep Dive Into the Online Reporting Suite (ORS) for Interim Assessments August 21, 2018 1. ... • A preliminary data file](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec9452b72be17753f32ed6a/html5/thumbnails/46.jpg)
Customer Support
Texas Assessment Support Center
• Monday–Friday
• 8:00 a.m.–5:00 p.m. CT
• 855-333-7770
• [email protected] or [email protected]
46