M0 school leader orientation-final
-
Upload
research-in-action-inc -
Category
Education
-
view
13 -
download
2
Transcript of M0 school leader orientation-final
1
Student Learning/Support
Objectives (SLO/SSO)
-School Leader Module-
Student
Learning/Support
Objectives
2
Module 0
Orientation to the SLO/SSO
Process
GoalProvide guidance and procedural suggestions to school
leaders for the implementation of student learning/support
objectives (SLO/SSO) as part of Mississippi’s Teacher
Effectiveness System (MTES).
Objectives
Participants will:
1. Explore the Student Learning/Support concept.
2. Identify roles and responsibilities needed to implement
Student Learning/Support Objectives (SSO).
3. Review tasks and suggested procedures for each
SLO/SSO phase (Design, Build, & Review).3
Orientation
4
CONCEPTUAL
FRAMEWORK
Student Learning Objective (SLO)
• An indicator of educator effectiveness based on
student achievement of targeted content standards.
Student Support Objective (SSO)
• An indicator of professional effectiveness based on
services provided to support student achievement.
5
What is a Student
Learning/Support Objective?
Five-Step Process
1. Develop a goal statement
2. Identify content or professional
standards
3. Create a blueprint with objectives and
assessments
4. Review the completed template
5. Evaluate student performance6
How is it Done?
1. Goals are based upon the key concepts within
Mississippi’s curriculum framework.
2. Objectives are specific, measurable, attainable, and
time-bound.
3. Teacher expectations of student achievement are
challenging.
4. Performance measures are valid, reliable, and
rigorous.
5. Performance data are collected, organized,
summarized, and reported in a consistent manner.7
Intent
Guiding Principles
SLO
1. Represent student performance in a specific
course or subject area taught by the educator.
SSO
1. Represent student performance in an identified
area of need to support achievement and school
success.
8
Guiding Principles (cont.)
SLO
2. Align to a set of Targeted Content Standards that
represents the depth and breadth of the Goal
Statement.
SSO
2. Align to a set of Professional Standards that
reflects the Goal Statement.9
Guiding Principles (cont.)
SLO & SSO
3. Contain results from high-quality performance
measures collected in an equitable, verifiable, and
standardized manner.
4. Use metrics based on two time-bound events (i.e.,
data collection periods) or on summative
performance measures with defined levels of
achievement.
5. Include performance targets linked to performance
measures. 10
11
PROCESS PHASE
The student learning/support objective process
includes three phases:
• Design(ing): think, organize, discuss, research
• Build(ing): select, develop, complete, share
• Review(ing): check, refine, edit, update, test
The SLO/SSO process contains five procedural
steps “nested” within the three phases (see Slide
6).12
Process Phases
Process Components
13
STEP #1 Goal
STEP #2 Standards
STEP #3 Blueprint
STEP #4 Form
STEP #5 QA
SLO/SSO Process: Major
Components
Performance Measures
Performance Indicators
Goal & Targeted Content/Professional
Standards
Goal
Objective #1
Assessment #1
Objective #2
Assessment #2
15
Blueprint-Art Grade 3 Example-
Goal Statement
Demonstrate the art skills,
techniques, elements, and principles
that are the foundation of visual
communication and are key to
communicating ideas, artistic
messages, mood, and feelings.
Objectives OBJ #1:
By the end of the final grading period, at least
75% of all students will earn at least one
Proficient rating within the Paper Weaving
Project.
OBJ #2:
By the end of the third grading period, at least
80% of all students will earn at least one Proficient
rating within the Still Life Painting Portfolio.
Targeted Content Standards
9.1.3.A; 9.1.3.C;
9.4.3.D
Performance Measures PM #1:
Paper Weaving Project comprised of three (3)
independent tasks.
PM #2:
Still Life Painting Portfolio comprised of four
(4) unique paintings.
*Note* Also see Handout #1: Designing the SLO, Step #3–Blueprint.
16
Blueprint-School Psychologists Example-
Goal Statement
Improve students' academic
achievement, positive
mental health, and social
competence using
interventions and mental
health services.
Objectives OBJ #1:
70% of all identified students will show
improvement on their targeted behaviors after
8 weeks of receiving services.
OBJ #2:
80% of all identified students will maintain
targeted behaviors after 16 weeks of receiving
services.
Targeted Content Standards
Interventions and Instructional Support to Develop Academic Skills
Interventions and Mental Health Services to Develop Social and Life Skills
Performance Measures PM #1:
Behavioral and Emotional Rating Scale
(BERS-2), Second Edition
PM #2:
Functional Behavioral Assessment
(FBA)-District
*Note* Also see Handout #1: Designing the SLO, Step #3–Blueprint.
17
School Leaders
Roles and Responsibilities
18
Generic Procedural Timeline
1. Establish initial SLO/SSO timeline at the
beginning of the school year
2. Review completed template with educator
3. Agree on any revisions; sign SLO/SSO
Template
4. Establish “mid-cycle” implementation check
5. Conduct end-of-year review of summarized
performance data
6. Determine rating; sign SLO/SSO Template
Timeframe
“Typical School Year”
19
July June
August September October November December January February March April May
● ● September
● ●
Implementing
● ●
Review PerformanceMarch
Design, Build, & Review (QA)
Phases
-Roles and Responsibilities-
20
DE
SIG
N
Roles & Responsibilities
Teachers:
Identify content standards and students
Specialists:
Identify professional standards and clients
Leaders:
Identify school-wide needs and timeline for submission
BU
ILD
Roles & Responsibilities
Teachers:
Identify performance measures and expectations within the SLO form
Specialists:
Identify performance measures and expectations within the SSO form
Leaders:
Clarify and guide SLO/SSOcompletion
RE
VIE
W
Roles & Responsibilities
Teachers:
Verify the SLO is complete and comprehensive
Specialists:
Verify the SSO is complete and comprehensive
Leaders:
Validate expectations and ensure coherency
Roles and Responsibilities
21
Assignments:
• are determined locally and could vary across
Mississippi.
• are flexible and may change during the school year.
• for SLO/SSO development may be “shared” across
grade-levels or departments.
• of new roles may include SLO/SSO trainer, co-
developer, and/or quality reviewer for lead teachers,
department chairpersons and other leaders.
22
Tasks and Procedures
23
Design Phase: Tasks
24
SLO and SSO Templates
Template 2a & 2c
The framework used to identify goals,
objectives, and performance measures
for the Student Learning/Support
Objectives Mississippi’s Teacher
Effectiveness System (MTES).
25
Template Sections
Context
Goal
Objectives
Measures
26
Design:
Educator/Professional Tasks
1. Identify subject (service area) and students
2. Concept/services from the content/professional
standards
3. Draft a goal statement and rationale
4. Identify preliminary objectives and
performance measures
5. Develop a “blueprint”
27
Design: Leader Tasks
1. Establish timeline and expectations for
SLO/SSOs
2. Identify training and other resources
3. Identify any school-wide needs that can be
supported by the SLO/SSO process
4. Disseminate achievement data from prior
year(s)
28
Build Phase: Tasks
29
Context
SLO Guiding Statement
“Let me begin by describing my classroom.”
General Description
• Contains demographic information about the educational setting.
• Identifies the course/subject, grades, and students the SLO focuses on.
• Provides class size, frequency, and time data.
30
Setting
SSO Guiding Statement
“Let me begin by describing the setting of my
support services.”
General Description
• Contains descriptive information about
the service setting.
• Identifies the service area and location,
students’ grade levels, and other service
and clientele information.
31
SLO Section I-Business RulesElement Definition
1.1 Content Area Name of the content area upon which the SLO is based
1.2 CourseName of the specific course/subject upon which the SLO is
based
1.3 Grade LevelGrade levels for students included in the course/subject in
Element 1.2
1.4 Total Students
Aggregate number of students (estimated, across multiple
sections) for whom data will be collected
1.5 Average Class
Size
The average number of students in a single session of the
course/subject identified in Element 1.2
1.6 Class FrequencyThe frequency (within the given timeframe) of the
course/subject identified in Element 1.2
1.7 Instructional
Setting
The location or setting where the course/subject instruction is
provided
1.8 Instructional
IntervalThe time frame of the course/subject identified in Element 1.2
32
SSO Section I-Business RulesElement Definition
1.1 Service AreaName of the primary service area (e.g., speech) upon which the
SSO is based
1.2 Service Location Name of the location(s) services are provided
1.3 Grade LevelGrade level(s) of students and/or educator-type services are
provided
1.4 Total RecipientsAggregate number of students and/or educators for whom data
will be collected
1.5 Average
Case Load
The “average” number of recipients of the services identified in
Element 1.4
1.6 Service
Frequency
The typical frequency (within the identified service interval-
Element 1.8) services are provided to recipients identified in
Element 1.4
1.7 Service SettingThe contextual setting (e.g., school library, student’s home)
services are provided
1.8 Service Interval The typical time frame of the service model
33
Goal
SLO Guiding Statement “Here is a key concept my students need to understand fully.”
General Description• Contains a statement about the key
concept the SLO is based upon.
• Provides the targeted content standards associated with the goal.
• Articulates an instructional strategy for the Goal Statement.
34
Goal
SSO Guiding Statement “Here is a primary service to my clientele.”
General Description• Contains a statement about the
primary service the SSO is based upon.
• Provides the targeted professional standards associated with the goal.
• Articulates an implementation strategy for the Goal Statement.
35
Element Definition
2.1. Goal Statement
A narrative that articulates a key concept upon which the
SLO is based. The statement addresses What, Why, and
How.
2.2. Targeted Content
Standards
Targeted Content Standards, which are the foundation of
performance measures, are used to develop the SLO.
2.3. Instructional
Strategy
The approach used to facilitate learning the key concept
articulated in the Goal Statement and delineated among the
Targeted Content Standards.
SLO Section II-Business Rules
36
Element Definition
2.1. Goal Statement
A narrative that articulates a key concept upon which the
SSO is based. The statement addresses What, Why, and
How.
2.2. Targeted
Professional
Standards
Targeted Professional Standards outline the requirements
an organization must fulfill to ensure that products and
services consistently meet customers' requirements.
Content standards may also be identified for those
individuals providing instructional services.
2.3. Implementation
Strategy
The approach used to attain the primary service goal
articulated in the Goal Statement and delineated among the
Targeted Professional Standards.
SSO Section II-Business Rules
Objective
37
SLO Guiding Statement “My students need to achieve these learning targets to be successful.”
General Description• Identifies a starting point (baseline) and end
point.
• Includes all students identified in Section I and may include a focused student group (optional).
• States the objective associated with each performance measure.
• Identifies empirical ranges for each performance category.
Objective
38
SSO Guiding Statement “My clientele need to achieve these performance targets to be successful.”
General Description• Identifies a starting point (baseline) and an end
point.
• Includes all clients identified in Section I and may include a focused client group (optional).
• States the objective associated with each performance measure.
• Identifies empirical ranges for each performance category.
39
SLO Section III-Business RulesElement Definition
3.1 Starting Point
(Baseline)
The baseline data used for comparing student results at the end of
the instructional interval.
3.2 Objectives
(Whole Class)
The expected level of achievement for the entire student learning
objective (SLO) population (as defined in Element 1.4).
3.3 Objectives
(Focused
Students)
The expected level of achievement for a subset of the SLO
population (as defined in Element 1.4).
3.4 End Point
(Combined)
At the end of the instructional interval, the aggregate performance
classification as delineated by four empirical ranges (i.e.,
Unsatisfactory, Emerging, Efficient, and Distinguished).
40
SSO Section III-Business RulesElement Definition
3.1 Starting Point
(Baseline)
The baseline data used for comparing student results at the
end of the instructional interval.
3.2 Objectives
(All Clients)
The expected level of performance for the entire client
population (as defined in Element 1.4).
3.3 Objectives
(Focused
Clients)
The expected level of performance for a subset of the client
population (as defined in Element 1.4).
3.4 End Point
(Combined)
At the end of the service interval, the aggregate performance
classification as delineated by four empirical ranges (i.e.,
Unsatisfactory, Emerging, Effective, and Distinguished).
41
Performance Measures
SSO Guiding Statement“These measures are best suited to evaluate my clientele.”
General Description• Identifies all performance measures, including
name, purpose, and metric.
• Articulates the administration and scoring details.
• Measures aspects of the professional services provided to clients.
*Note* Section IV is based upon high-quality performance measures aligned to the Targeted Content Standards. (See Quick Start training materials)
42
SLO Section IV-Business RulesElement Definition
4.1 NameThe name of each performance measure for which an objective is established in
Element 3.2.
4.2 Purpose
The purpose statement for each performance measure that outlines: (a) What the
assessment measures, (b) How to use the scores, and (c) Why the assessment was
developed.
4.3 Content Standards
The Targeted Content Standards (the foundation of performance measures) used to
develop SLOs. The content standards are those aligned with each performance
measure.
4.4 Performance Targets
Using the scoring tools for each performance measure (as listed in Element 4.1), the
expected level of achievement for each student in the SLO population (as defined in
Element 1.4).
4.5 Metric The metric by which the performance measure evaluates the performance target.
4.6 Administration
The administrative steps before, during, and after the assessment window, as well as
the step-by-step procedures during each phase of administration; The requirements for
completing the performance measure, including accommodations, equipment, and
materials; The standard time to complete the overall performance measure; The
standard scripts that educators read to give directions for completing the performance
measure.
43
Element Definition
4.7 Scoring Tools
Scoring Keys: Objective Measures
Scoring Rubric: Subjective Measures
4.8 Results
The number of students participating in the performance measure
The number of students who met the target as stated in Element 4.4
The percentage of students who met the target as stated in Element 4.4
SLO Section IV-Business Rules
(cont.)
Element Definition
SLO Rating One of four performance levels that the principal (or the evaluator) identifies after noting
the actual performance in respect to each objective stated in the SLO.
Note: Complete this section only after collecting, reviewing, and evaluating performance
data against each performance target.
Notes
and
Explanation
Space for the educator to note influences, factors, and other conditions associated with
the SLO Rating, as well as to reflect on a purposeful review of the data.
Note: Complete this section only after collecting, reviewing, and evaluating performance
data against each performance target.
44
SSO Section IV-Business RuleElement Definition
4.1 NameThe name of each performance measure for which an objective is
established in Element 3.2
4.2 Purpose
The purpose statement for each performance measure that outlines: (a)
What the measure is evaluating, (b) How to use the scores, and (c) Why the
measure was developed
4.3 Professional
Standards
The Professional Standards (the foundation of measures) used to develop
SSOs. The professional standards are those aligned with each identified
measure.
4.4 Performance Targets
Using the scoring tools for each performance measure (as listed in Element
4.1), the expected level of attainment for each client in the SSO population
(as defined in Element 1.4)
4.5 MetricThe metric by which the performance measure evaluates the performance
target
4.6 Administration
The administrative steps before, during, and after the evaluation window,
as well as the step-by-step procedures during each phase of administration;
the requirements for completing the performance measure, including
accommodations, equipment, and materials; the standard time to complete
the overall evaluation.
45
Element Definition
4.7 Scoring ToolsScoring Keys: Objective Measures; Scoring Rubric: Subjective Measures;
Data collection mechanisms
4.8 Results
The number of clients participating in the performance measure; the number
of clients who met the target as stated in Element 4.4; the percentage of
clients who met the target as stated in Element 4.4
SSO Section IV-Business Rules
(cont.)
Element Definition
SSO Rating One of four performance levels that the principal (or the evaluator) identifies after noting
the actual performance in respect to each objective stated in the SSO.
Note: Complete this section only after collecting, reviewing, and evaluating performance
data against each performance target.
Notes
and
Explanation
Space for the educator to note influences, factors, and other conditions associated with
the SSO Rating, as well as to reflect on a purposeful review of the data.
Note: Complete this section only after collecting, reviewing, and evaluating performance
data against each performance target.
46
SLO Rating -P.E. Grade 7 Example (cont.)-
SLO Rating
Distinguished
• Effective
• Emerging
• Unsatisfactory
Notes and Explanation
Objective was 95.0%; overall actual
performance, 96.2%.
* Note* See also Handout #2a: Building the SLO, Step #4–SLO Form.
47
SSO Rating - School Psychologists Example (cont.)-
SLO Rating
Distinguished
• Effective
• Emerging
• Unsatisfactory
Notes and Explanation
Behavior intervention plans, along with
home-school compacts, were highly effective
in communicating antecedents.
* Note* See also Handout #2c: Building the SSO, Step #4–SLO Form.
48
Build: Leader Tasks
1. Clarify expectations for SLOs/SSOs
2. Provide additional training and other resources
3. Screen draft material prior to conferencing with
educator
4. Designate a school-based, subject matter expert
to support development
5. Coordinate district and external professional
development services
49
Review Phase: Tasks
50
Helpful Resources
Participants should consult the following:
Training
• Handout #3: QA Checklist
Step 5: Quality Assurance of the SLO/SSO form
Templates
• Template #3: Coherency Rubric
• Template #3a: Performance Measure Rubric
Resources• Help Desk
• Demonstration #1-Art Grade 3-DEMO-Final
• Demonstration #2-School Psychologists-DEMO-Final
Participants should consult the following:
A. Completion of the SLO Form
• Handout #3-Quality Assurance Checklist
B. Comprehensiveness of the Performance
Measures
• Template #3a-Performance Measure Rubric
C. Coherency of the SLO Design
• Template #3-Coherency Rubric
51
Helpful Resources (cont.)
52
Task Structure
QA 1. Completeness
Is the SLO/SSO Form completed correctly?
2. Comprehensiveness
Are the assessments of high technical quality?
3. Coherency
Are the SLO/SSO components aligned to each other?
Final Deliverables
53
A refined SLO/SSO Form with:
• Rigorous, high-quality performance
measures designed to measure the
targeted content/professional
standards.
• Areas identified for further
improvement/consideration (as
documented within the Coherency
Rubric).
54
Review: Educator Tasks
1. Evaluate each Section of the SLO/SSO Form
(Template #2) using Handout #3-Quality Assurance
Checklist
2. Identify and correct any element that deviates from
the business rules
3. Organize the template, assessments, and summary
data
4. Conduct review with school leader
5. Finalize and sign form
55
Review: Leader Tasks1. Conduct preliminary review (screen) of proposed
SLO/SSO
2. Implement conference with educator:
a) Develop “triage” of screening materials
b) Align time allocation given preliminary review
c) Provide “key points of discussion” prior to
conference
3. Discuss proposed SLO/SSO and applicable
performance measures
4. Identify any corrections, refinements, etc.
5. Sign form and establish follow-up timeline
56
Procedural
-Conference-
The SLO/SSO process facilitates an
ongoing conversation about expectations
between educators and school leaders
57
Procedural
-Discussion Points: Fall-
Goals-Standards
• What is the subject/service focus?
• Whom does it encompass?
• How can it improve instruction/practice?
Measures
• Why are they considered high quality measures?
• Who administers and scores the measures?
• What types of data are produced?
Indicators
• What are the indicators of success?
• How are they being measured?
• Which students are they based upon?
58
Procedural
-Discussion Points: Winter-
Goals-Standards
• How has the instruction/intervention supported the subject/content focus?
• Which student groups are making progress or struggling?
• What instruction/practice adaptations will be needed in the spring?
Measures
• Which measures have been administered so far?
• Are additional measures necessary at this time?
• What is the data telling us about student growth and/or mastery?
Indicators
• Are indicators of success still applicable?
• How well are the indicators working?
• Which indicators are producing data about student performance?
59
Procedural
-Discussion Points: Spring-
Goals-Standards
• To what degree was the key concept/skill mastered by students?
• Which content/professional standards will need additional instruction?
• How can the standards be taught more effectively?
• How can the service be provided more effectively?
Measures
• Which measures should be discontinued or need significant revisions?
• To what degree did students meet your expectations?
• What data points had the most influence on your overall rating?
Indicators
• Which indicators were established too high or too low?
• What did the indicators tell you about student performance?
• Which student groups underperformed on selected indicators?
60
Procedural
-Areas of Caution-
1. SLO/SSO is based upon small numbers of
students or data points.
2. Goals and/or objectives are “loosely” linked
to targeted standards.
3. Objectives are vague without specific criteria.
4. Growth and/or mastery is not clearly defined.
5. Performance measures are poorly designed,
lack rigor, or do not measure the targeted
standard(s).
61
TRAINING
62
Integrated SLO/SSO Training
Training
Phases
Module 2
Building SLOs
Module 1
Designing SLOs
SLO/SSO
Process
Module 3
Reviewing SLOs
Module 0
Orientation
Assessment
Literacy
Process via
Quick Start
Module 1
Designing SSOs
Module 2
Building SSOs
Module 3
Reviewing SSOs
Training Describes the procedures within each of the three (3)
phases (i.e., Design, Build, and Review).
Provides examples and information about the process.
Templates Assist in developing customized student learning
objectives (SLO) or student support objectives (SSO),
including performance measures.
Resources Supplement the core training material. 63
SLO/SSO Components
64
65
66
Orientation to the SLO/SSO Process• Shared how the student
learning/support objective (SLO/SSO)
process involves three phases, each
having three components that integrate
the training experience.
• Reviewed the SLO/SSO terminology
and online training material.67
Summary