SURVEY RESULTS SY 2012-2013 · Safety Creativity & The Arts Learning Climate The Teachers Physical...

BALTIMORE CITY PUBLIC SCHOOLS

SCHOOL SURVEY RESULTS SY 2012-2013

PRESENTATION TO THE BOARD OF COMMISSIONERS

JULY 9, 2013

1


Executive Summary

Notable changes were made to the school survey items and administration processes with the goal of improving data quality & usefulness

Parent participation increased from last year; response rates remained stable for staff, and declined for students

Reports of satisfaction with school are generally high, with over 80% of staff and parent respondents, and over 70% of student respondents reporting feeling satisfied with school

Perceptions of family involvement are generally quite positive, with more than 80% of staff and parent respondents, and more than 70% of student respondents reporting that families are involved in their schools

Perceptions of the School Physical Environment are particularly low among students and staff; These findings support the findings from the Jacob’s report and the district’s efforts to improve our school buildings

Schools will receive individualized reports highlighting their scores on 6 key items and their strengths and areas of improvement according to each respondent group; District scores on these 6 key items, and strengths and areas of improvement are highlighted in this presentation to mirror results to be shared with schools

2


School Survey Overview

The School Survey consists of 11 dimensions: Safety

Creativity & The Arts

Learning Climate

The Teachers

Physical Environment

School Resources

The Administration

Family Involvement

Satisfaction with School

Grit1

Meaningful Work2

Each student in grades 3-12 and each staff member at a given school received one survey. All parents of students in PreK-12 also received a survey.

Parent and student surveys have been administered in hard copy only. Staff surveys have been administered online. All surveys are anonymous. This year, parents had the option to complete the survey online.

3

1 New in 2012; for CEO/Board Goals 2New in 2013; for CEO/Board Goals. Not all dimensions are surveyed for all respondent groups


School Survey Revision Process: Extensive Revisions to the School Survey were completed during SY12-13

4

• OAA, PCCE, BERC, JHU • Many items on the existing survey do not

differentiate schools effectively. Statistical Workgroup

• PCCE, OSS, T&L, Networks, Food & Nutrition, ONI, HC, COO, COS

• What items are used? What should be added/removed?

Input from Central Offices

• Combined Climate Survey with student surveys for Teacher Evaluation

• Alignment Exercise; mapping to Instructional Framework

Alignment with Instructional Framework

• Advisory Group Meetings (PCAB, PTA, SEACAC, CUE, Arts Everyday)

• Focus Groups with students, community resource providers, and research partners

Feedback from Community

Stakeholders


The Revised Survey

Surveys aligned to City Schools’ Instructional Framework

“The Teachers” domain was removed from the Student Survey (now measured by the Student Survey on Teacher Practice*);

Student surveys now shorter than in previous years, and available in English and Spanish

The Grade 3-5 survey was shortened from 43 to 33 items

The Grade 6-12 survey was shortened from 60 to 41 items

Parent survey available on paper and online in English & Spanish

Parent survey was shortened from 52 to 48 items

Item wording was streamlined across all surveys to improve readability

5

* The Student Survey on Teacher Practice was administered to students in SY12-13 as part of the teacher evaluation field test.


15,355

9,256 12,143

School Survey Response Counts

6

5,600 5,718 5,430

Note: In previous years, total staff counts may have included non-classified staff. In 2012 and 2013, only professional and Para-professional staff were surveyed. Students in grades 3-12 were included in the survey.

9,898 9,004 8,679

2007 2012 2013

1 yr change 6 yr change

Number change

Pct change Number change

Pct change

-288 -5.0% -170 -3.0%

40,204 41,148 39,206

53,066 58,198 58,604

2007 2012 2013


Number change


Pct change

-1,942 -4.7% -998 -2.5%


Number change


Pct change

+2,887 +31.2% -3,212 -20.9%

NA NA NA

2007 2012 2013

S T A F F S T U D E N T S P A R E N T S


Student Response Rates By Grade Band

7

87%

63%

85%

59%

Note: Ns reflect enrollment counts for each grade band at the beginning of the survey window therefore these counts may not match official 9.30 enrollment counts. *Please note that 2013 enrollment counts exclude school #s 301, 303, 307, and 313 which are special education schools who did not participate in the survey. Counts for 2012 exclude 303 and 313 only.

18,036 18,297

2012 2013

1 yr change

Pct. Pt. change Pct change

-2.0 -2.3%

40,145 40,307

2012 2013

1 yr change

Pct. Pt. change Pct change

-4.0 -6.3%

G R A D E S 3 - 5 G R A D E S 6 - 1 2


Staff Survey Results by Domain

86.6 86.4 82.4

80.2 75.3

70.5 71.3

53.5

89.4 87.1

83.4

77.4 74.7 74.5

63.5

69.6

46.9

92.2 89.8

85.9

77.3 76.5 76.5 77.3

71.8

46.6

The Teachers Satisfaction with School

Family Involvement

The Administration

Learning Climate

School Resources

Creativity & the Arts

School Safety Physical Environment

2007 2012 2013

8

* Questions on the Creativity & The Arts dimension were first asked in SY2008-09. All dimension scores reflect the average percent agreement across items. Only items that were consistently administered across all years are included in the historical trends for the dimension score. The dimension score for ‘Creativity & The Arts’ is based on a single item that was asked in all years: “The arts (music, art, theatre and dance) make my school a better place.”

*


Student Survey Results by Domain

66.8 68.4

57.4

49.3

40.1 43.6

71.3 74.0

59.7

68.4

54.1

30.4

39.7

71.5 71.4 69.1 68.0

58.1

30.7

40.4

Family Involvement Satisfaction with School

Creativity & the arts

School Resources School Safety Physical Environment

Learning Climate

2007 2012 2013

9

* Questions on the Creativity & The Arts dimension were first asked in SY2008-09. All dimension scores reflect the average percent agreement across items. Only items that were consistently administered across all years are included in the historical trends for the dimension score. +The dimension score for the ‘Learning Climate’ is based on a single item that was asked in all years: “Students respect each other”.

*

+


Parent Survey Results by Domain

89.4

87.2

83.1

85.2

79.0

75.6

80.7

82.4

88.9

85.3

88.3

86.0 87.1

83.1

81.6

83.4 82.4

90.6 90.0 88.6

87.5 86.5

84.6 84.4 84.1 83.7

Learning Climate

Creativity & the arts

The Teachers School Safety Satisfaction with School

School Resources

Family Involvement

The Administration

Physical Environment

2007 2012 2013

10

* Questions on the Creativity & The Arts dimension were first asked in SY2008-09. All dimension scores reflect the average percent agreement across items. Only items that were consistently administered across all years are included in the historical trends for the dimension score. + The dimension score for ‘The Administration’ is based on a single item that was asked in all years: “The school administration promptly responds to my concerns”; the ‘Physical Environment’ dimension score is based solely on parent responses to the item “The school building is clean and well maintained.”

*

+ +


New School Survey Reports for Schools

One of the primary goals of the survey revision was to create a tool that would be more useful to schools. In order to disseminate results in a more digestible way, OAA is creating school reports that highlight two areas:

Six ‘key items’ from the survey that are important indicators of school climate, based on an extensive review of the research on school climate.

Areas of strength and areas for improvement according to each respondent group (parents, staff, and students). *

The following slides illustrate the district level results on key items as well as overall areas of strengths and weaknesses, according to parents, staff, and students.

11

* The highest rated 5 items reflect district (or school) strengths according to students, staff, and parents; The lowest rated 5 items reflect potential areas for improvement for the district (or school)


Key Items: Social Relationships & School Connectedness

12

40.4%

61.3% 58.6%

83.9% 86.9%

Note: * Indicates that parents were not asked this item. 1 The wording of this item was modified as part of the revisions to the school survey. The old item stated “Students get along well with each other.”. 2 This item was asked of students, staff, and parents about their student for the first time on the 2013 school survey

58,604 8,679 NA

Students Staff Parents

S T U D E N T S R E S P E C T E A C H O T H E R 1

F E E L L I K E I B E L O N G A T T H I S S C H O O L 2

* 58,604 8,679 NA



Key Items: Safety & Discipline

13

65.6% 64.5% 62.9%

78.1% 84.0% 86.2%

Note: 1This item was asked of students, staff, and parents for the first time on the 2013 School Survey.

58,604 8,679 NA


I F S T U D E N T S B R E A K R U L E S , T H E R E A R E F A I R C O N S E Q U E N C E S 1

S T U D E N T S F E E L S A F E A T T H I S S C H O O L

58,604 8,679 NA



Key Items: Academic Support & Satisfaction with School

14

81.9% 75.5%

96.1% 91.3% 88.1%

Note: * Indicates that parents were not asked this item.

58,604 8,679 NA


T E A C H E R S P R O V I D E E X T R A A C A D E M I C H E L P T O

S T U D E N T S W H O N E E D I T

I L I K E T H E C L A S S E S I T A K E / T E A C H

58,604 8,679 NA


*


15

20.9

51

54.9

55.2

58.3

95.2

95.3

96.1

97.2

97.4

[RECODED] Sometimes it is too hot or too cold at my school*

Students picking on/bullying other students is [NOT] a problem at my school*

Students fighting is [NOT] a problem at my school*

Students are [NOT] often in the hallways during class time at my school*

I have the opportunity to provide input into the school's budgetary decisions.

Teachers feel responsible for their students' academic success

Parents or guardians are welcome at this school

Teachers provide extra academic help to students who need it

Teachers inform students about what they should be learning in class

Teachers care about their students

Note: Items with an * indicate that the item has been recoded so that the percentages shown reflect a positive response. Words noted in the bracket reflect the meaning of the score.

Strengths and Areas for Improvement: Staff Report

S T R E N G T H S

A R E A S F O R I M P R O V E M E N T


16

19.3

30.2

37.3

38.5

38.6

81.2

81.9

83.4

89.2

91.7

[RECODED] Sometimes it is too hot or too cold at my school*

I like the food at my school

Students fighting is [NOT] a problem at my school*

[RECODED] I get distracted by noises outside my classroom*1

Students are [NOT] often in the hallways during class time at my school*

I can pass all subjects at school

There is someone at school who can give me extra help w/ schoolwork when I need it

When I do something bad at school, my parent/guardian hears about it

I learn a lot at my school

It is important for me to come to school everyday

Note: Items with an * indicate that the item has been recoded so that the percentages shown reflect a positive response. Words noted in the bracket reflect the meaning of the score. 1This item was asked for the first time on the 2013 School Survey.

Strengths and Areas for Improvement: Student Report

S T R E N G T H S



17

65.7

70.0

77.6

80.0

80.6

94.9

96.2

96.8

96.9

98.4

Parents can use resources at my child's school when school is not in session

I am satisfied with the meals that my child receives at school***

When my child does something good at school, I usually hear about it from the school

My child's school can connect me to resources in the community***

My child's school has programs to support students' emotional and social development

My child's school sends me information in my native language**

Teachers at this school know my child's name.

I encourage my child to keep working at difficult tasks until he/she figures them out***

Regular on-time attendance is important to my child's success in school

Parents ask their child what he/she did at school at least once per month*

Note:*The response choices for this item differ from all other items. The responses range from Never to Every Day and the information shown reflects parents who reported engaging in the behavior at least once per month or more frequently. **Please note that this item was only asked of parents who completed the Spanish version of the survey. ***These items were asked for the first time on the 2013 School Survey.

Strengths and Areas for Improvement: Parent Report

S T R E N G T H S



Next Steps

In July, schools will receive reports that highlight their school’s scores on the 6 key items highlighted in this presentation as well as their school’s strengths & areas for improvement according to each stakeholder group

During the summer, focus groups will be conducted with various stakeholders to obtain feedback on the survey administration timing and process. This feedback will be used to inform the SY13-14 survey administration

In early Fall, schools will receive a survey toolkit that will include handouts and other tools to facilitate the discussion of survey results with the school community and the use of survey results in school initiatives

18


Appendix

19


Background on Survey Dimension Scores

Safety: Includes items examining the extent to which different types of safety issues (e.g., bullying, vandalism) are a problem at the school, and the extent to which students and staff feel safe at the school

Creativity & The Arts: Items measure perceptions of whether the arts make school a better place, whether students are encouraged to think creatively, and whether student work in the arts is displayed in the school

Learning Climate: Items measure respect among staff and students, rules and consequences, college and career focused school atmosphere, and whether students and staff feel connected to the school

The Teachers: Items measure extent to which teachers make learning goals clear, encourage students to challenge themselves, are organized and prepared, and feel responsible for their students academic and social-emotional development

Physical Environment: Items measure perceptions of the cleanliness, temperature, food, lighting, and noise level in the school

School Resources: Items measure the adequacy of supplies/school materials, school-based professional development, and programs/services to support students with academic and personal difficulties

20


Background on Survey Dimension Scores

The Administration: Items measure extent to which the administration provides opportunities for stakeholders to give feedback, is responsive to concerns, is supportive and provides helpful feedback to staff, and clearly communicates with stakeholders about expectations and the school mission

Family Involvement: Items measure extent to which the school communicates with parents about issues pertaining to their children, and that parents have opportunities to get involved (e.g., volunteering) in the school

Satisfaction with School: Items measure extent to which stakeholders like the school, feel that students obtain a good education at the school, would recommend it to others, and would choose to stay at this school

Grit: Items measure extent to which students persevere with schoolwork even when it is hard, and that they feel efficacious in their ability to finish homework and pass tests.

Meaningful Work: Items measure extent to which staff perceive that their work contributes to their own growth as well as the success of the district

21

SURVEY RESULTS SY 2012-2013 · Safety Creativity & The Arts Learning Climate The Teachers Physical...

Documents

Transcript of SURVEY RESULTS SY 2012-2013 · Safety Creativity & The Arts Learning Climate The Teachers Physical...