1

Academic Support Grantee Academic Support Grantee Data TrainingData Training

Department of Education

Hoagland-Pincus Center (UMass)

Shrewsbury, MA

January 13, 2005

2

FY04 School Year ProgramsFY04 School Year Programs Highlights (all fund codes) Highlights (all fund codes)

248 districts, high schools, community colleges, and partnering organizations served 8,653 students in the classes of 2003-2006.

Participating students each received an average of 27.3 hours of MCAS remediation service.

4,234 of the students served earned their competency determination (CD) after participation in the program.

24% more students participating in AS programs earned their CD compared to those not participating in AS programs (60% compared to 36%).

3

A) FY04 School Year Programs - Percentage of Participants by Original Class Year

Seniors (Class of '04)

24%

Previous Year's Seniors

(Class of '03)3%

Sophomores (Class of '06)

17%

Juniors (Class of '05)

56%Note: Eligible classes vary program to program.

4

FY04 School Year Programs -FY04 School Year Programs -Highlights (all fund codes)Highlights (all fund codes)

58% of programs took place during the school day, 37% during extended time (before or after-school/evening),

5% during the weekend.

70% of programs focused on mathematics; 30% on English language arts.

18% of students served were from vocational schools.

50% of participating students received individual (1 teacher:1 student) or smallest group instruction (1:2-5),

45% received small group instruction (1:6-10), and 5% received an “other” type of instructional model.

5

B) Pre/Post MCAS Averages by Subject

212

214

216

218

220

222

224

ELA MTH

Subject

MC

AS

Ave

rag

e

Pre

Post

+4.9 +7.4

Passing

6

C) Pre/Post MCAS Averages by Fund Code

212

214

216

218

220

222

224

596 598 619 632

Fund Code

Pre

Post

+6.8 +3.6 +4.9 +6.9

Work & Learning Community Colleges Districts/ Partners - Competitive Districts - Allocation

7

D) Pre/Post MCAS Averages by Instructional Model

212

217

222

227

1:1 1:2-1:5 1:6-1:10 Other

Instructional Model(Teacher to Student Ratio)

MC

AS

Ave

rage

Pre

Post

+7.8 +7.4 +6.1 +5.6

Passing

8

E) Pre/Post MCAS Averages by Hours of Service

212

214

216

218

220

222

224

1-10 11-20 21-30 31-40 41-50 50+

Average Hours of Service per Student

MC

AS

Ave

rage

Pre

Post

+7.0 +6.8 +6.3 +5.3 +4.8 +6.5

9

F) Pre/Post MCAS Averages by Project Type

212

214

216

218

220

222

224

School Day Extended Day Weekend

Project

MC

AS

Ave

rage

Pre

Post

+6.0 +6.5 +6.5

10

Included in reports for legislature and Board of Ed. Viewed as a reflection of program effectiveness Influences TA provided to grantees Considered when determining funding amts. for

grant programs and individual grants Cost per pupil #’s served Completion rates Gains made on MCAS tests Dosage effect (effect of increased participation hrs.)

How Department Uses How Department Uses Academic Support Data?Academic Support Data?

11

What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?

SASID Student Name, Grade, School Fund Code (School Year / Summer)

Allocation Grants632/625 – Districts/Approved SPED Schools

Competitive Grants596/597 – Work and Learning Programs598/593 – Community Colleges/Partners 619/592 – Districts/Partners

12

What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?

Project Info. (e.g. ELA3D – HS English during day)

Content Area Grade

Levels

Schedule Type

MTH - Math 3 - HS D – During

ELA – English Lang. Arts

8 - Vocational E - Extended

9 – SPED Placement

T - Weekend

0 – 9th/10th S – Summer Vacation

13

What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?

Instructional Model (Teacher:Student)1:1 (Individual)1:2-5 (Smallest Group)1:6-10 (Small Group)Other (*Note: Must explain in narrative evaluation)

Hours of Service per Student Pre/Post MCAS Scores (*Note: Entered by Department)

14

What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?

Student Status– Completed Program:

Participated in at least 75% of possible hours of service

– Withdrew: Participated in fewer than 75% of possible hours of service

– Enrolled, but did not attend: Initially enrolled; zero hours of service

– Participated until receipt of 220+ score: Attended program until s/he learned (during the program) that s/he passed the most recent MCAS test; hours of service > zero

– Transferred out of school/district: Student was enrolled and may have attended, but s/he did not complete program due to transferring out of the school/district.

15

How to Use Data?How to Use Data?

Inform narrative evaluations and future proposals Improve your program

Do we need to increase outreach efforts? Is Day vs. Extended better for attendance and outcomes? Are more service hours correlated to greater MCAS gains? Was there more success with ELA vs. MTH – why? What was the most important factor for MCAS score gains?

Build support for your program

(e.g. present data to school board or to other potential funders)

16

How to Improve Data How to Improve Data Collection?Collection?

Appoint central person to plan collection and input data into security portal.

Make sure central person has access to security portal and is aware of deadlines.

Have central person share with program instructors the data that needs to be collected, their role in the collection process, and why it is collected.

17

How to Improve Data How to Improve Data Collection?Collection?

Suggestions:

Maintain data in an excel spreadsheet before inputting into the security portal. (http://www.doe.mass.edu/as/data/as_template.xls)

Start entering data into security portal at least two weeks before due date to account for issues that may arise and so that it can be used to inform your narrative. (http://www4.doemass.org)

18

When are theWhen are theData Submission Due Dates?Data Submission Due Dates?

Session Times: Data Due Dates

Fall (Sept. to mid-Nov).: 1/31/05 *Winter (Late-Nov. to early-Mar.): 4/30/05Spring (Feb/Mar. to May/June): 7/31/05 **Summer (July to August): 9/30/05 **

* Mid-year narrative evaluation & data reports due for fund code 598.

** Narrative evaluations due for all fund codes (& for FC598/593 data report).

19

20

21

22

23

24

25

26

27

28

29

Questions?

Contact Allison Ward,Academic Support Data Specialist

Tel: 781-338-3232

Email: ACsupport@doe.mass.edu

Website: http://www.doe.mass.edu/as/data