At d & data presentation

40
Pierce College Leadership Retreat: Achieving the Dream Overview: August 23, 2011

description

 

Transcript of At d & data presentation

Page 1: At d & data presentation

Pierce College Leadership Retreat:

Achieving the Dream Overview:

August 23, 2011

Page 2: At d & data presentation

What is Achieving the Dream?

Dr. Terri Manning & Dr. John Nixon

Page 3: At d & data presentation

Success is what counts. 3

ATD: A national initiative for student success

ATD defines student success: earning degrees, certificates, or transferring.

ATD focuses on all students but attempts to eliminate gaps for certain cohorts of students who lag.

ATD uses data to study college barriers, ask the “why” questions, and develop and implement likely solutions.

ATD understands that trial and error is necessary in this process but expects “ramping up” of successful pilots.

Page 4: At d & data presentation

Success is what counts. 4

ATD has built a NATIONAL NETWORKOver 130 institutions, 24 states & District of Columbia

More than1 million students enrolled in ATD colleges

Page 5: At d & data presentation

Success is what counts. 5

More students are coming to community colleges regardless of their readiness to learn.

Community colleges are not producing adequate numbers of graduates or completers.

The national spotlight is on community colleges. The public does not understand our attempts to

“explain away” our failures. The public and funding agencies want to see

results. Increasingly our funding will come from our results.

The Issues

Page 6: At d & data presentation

Success is what counts. 6

Students progressing successfully through developmental courses

Students advancing from developmental courses into and through gateway courses

Students successfully completing college-level courses (grade of C or better)

Students re-enrolling from one semester to the next, and from year to year

Students earning degrees, diplomas and certificates. 

Goals of Achieving the Dream

Page 7: At d & data presentation

Success is what counts. 7

Roles of the coaches in ATD: We are your CRITICAL FRIENDS.

Communication through at least two visits yearly for two years—THREE THIS FIRST YEAR

Conference calls, email, telephone advice Reporting processes Asking key questions Connecting to similar institutions, possible partners Encouragement to engage in crucial college

conversations Guide and provide feedback on the collection,

analysis and use of data

Page 8: At d & data presentation

Creating a Culture of Evidence

Page 9: At d & data presentation

Reference: Gonzalez, K. P. (2009). Using data to increase student success: A focus on diagnosis.

Achieving the Dream Inc. www.achievingthedream.org

Component One

Component Two

Component Three

Component Four

“What’s Wrong?”(Outcome Measures)

“Why?”(Underlying Factors)

Intervention(s) Evaluation &Modification

Use Longitudinal, Disaggregated, Cohort data to assess Student Success Outcomes (e.g., Persistence, CourseCompletion rates, Degree comp. rates) to determine: 1) Which student groups are less successful than others (Equity Gaps in Student Success). 2) Which high enrollment courses have the lowest success rates.

Collect, analyze, and use second set of LOCAL data to identify the underlying factors (barriers or challenges) impeding student success:

• Focus Groups• Surveys• Literature Reviews• Learning Outcome Assessment

Use data from Component Two to revise or design new interventions to effectively address the underlying factors impeding student success.  Review and consider changes to existing college policies that impact the underlying factors impeding student success.

Collect, analyze, and use evaluation data to answer: 1) To what extent did the interventions (or policy changes) effectively address the underlying factors impeding student success?

2) To what extent did the interventions increase student success?

Make modifications based on evaluation results.

Many Colleges:(a) Skip(b) Loosely rely on national literature (Engagement)(c) Lack a local understandingbased on qualitative data

Page 10: At d & data presentation

What happens to our students?

Page 11: At d & data presentation

Success is what counts. 11

Every Fall at Pierce:

Approximately 3,000 new students begin their higher education career

48% are female

75% are under 20 years old

Over 1/3 are Latino

Over 75% are LAUSD graduates from the previous year

Who are They?

Page 12: At d & data presentation

Success is what counts. 12

They enter the pipeline

Where they enter and where they go…. depends on Where they enter and where they go…. depends on where they have been and what they have donewhere they have been and what they have done.

Page 13: At d & data presentation

Success is what counts. 13

Degree seeking, college ready in all subjects

Undecided, need remedial in all three subjects

Casual student, no placement tests on file

Transfer in – credit in math and English

Transfer out – only taking 12 hours

Page 14: At d & data presentation

Success is what counts. 14

In Fall 2007, 2,988 new full and part-time students entered Pierce. Here is what happened to them.

Let’s look at one cohort of students

Page 15: At d & data presentation

Success is what counts. 15

For every 100 new students who entered Pierce (full and part-time)…

Page 16: At d & data presentation

Success is what counts. 16

91 are left by the end of the first term (9 didn’t make it).

Page 17: At d & data presentation

Success is what counts. 17

Only 67 return in the next spring term.

Page 18: At d & data presentation

Success is what counts. 18

Only 55 come back the next fall.

Page 19: At d & data presentation

Success is what counts. 19

After two years, 41 are still with us.

Page 20: At d & data presentation

Success is what counts. 20

Within three years, 5 have earned a degree or certificate.

Page 21: At d & data presentation

Success is what counts. 21

22 are still enrolled2 are certified to transfer

71 remain unaccounted for

What happened to the other 95 students?

Page 22: At d & data presentation

(we are not alone)

Issues Impacting Our Students Are National Issues Impacting Other Community College Students

Page 23: At d & data presentation

Success is what counts. 23

What We Know Nationally

Of 2002 Achieving the Dream Cohort, % Needing Developmental Education

Source: Achieving the Dream Data Notes,1(6) July/Aug 2006.

Page 24: At d & data presentation

Success is what counts. 24

How are they doing?Percent of 2002 AtD Cohort referred to developmental education that attempted and completed at least one developmental course during their first term, by race.

Source: Achieving the Dream Data Notes, 1(6) July/Aug 2006.

Page 25: At d & data presentation

Success is what counts. 25

How are they doing?

Retention Rates 2nd Term 2nd Year

Referred to DE – did not complete any

57% 45%

Referred to DE – partially completed

85% 65%

Referred to DE – completed all 94% 80%

Not referred to DE = college ready 66% 54%

All students 70% 57%

Percentage of AtD students persisting by developmental status at the end of the first year.

Source: Achieving the Dream Data Notes, 3(4), July/August 2008.

Page 26: At d & data presentation

Success is what counts. 26

Placement test scores (tested in summer or fall of 2009)

Pierce Students

English Math

Count % Count %At College Level (transfer level) 458 12% 842 20%

One Level Below 1393 35% 1308 31%

Two Levels Below 1689 43% 1438 34%

Three Levels Below 395 10% 601 14%

Four or more Levels Below N/A N/A 90 2%

Total with Scores 3935 100.0% 4279 100.0%

Page 27: At d & data presentation

Success is what counts. 27

First-Time Freshman Persistence: Fall Cohorts 2004 – 2009

CohortFall 2004

Fall 2005

Fall 2006

Fall 2007

Fall 2008

Fall 2009

Enrollment Count 3,549 3,719 3,300 3,567 4,057 3,905Persistence to Spring Semester 69% 68% 68% 68% 68% 66%

Page 28: At d & data presentation

An Example of a Data Set

Page 29: At d & data presentation

Success is what counts. 29

We Need to Take a Serious Look at Our Issues

We begin now with today’s activity.

We want the “great minds” of the college to look at the data and begin to address the issues related to student success.

We are not going to talk about “why” our students have issues until we better understand “what” the issues are.

Page 30: At d & data presentation

Table Discussion

Dr. Terri Manning

Page 31: At d & data presentation

Success is what counts. 31

Instructions for Table Top Activity

Each table has flip chart paper, and an envelope.

Distribute the contents of the packet to everyone at the table – includes a data set and three questions.

We are looking at 5 data sets today (each table has only one): Progress in Developmental Math Progress in Developmental English Gatekeeper Courses Persistence by Subgroups Awards Earned by Subgroups

Page 32: At d & data presentation

Success is what counts. 32

Table Top Activity

Assign a timekeeper, recorder and reporter

Review your data, discuss it as a group (30 minutes)

On the flip chart paper, list the following:

1. What’s the story line?

2. What surprised you the most?

3. What additional data/information would you like to see about this particular data set?

We will then report out.

Page 33: At d & data presentation

Roles and Responsibilities

Page 34: At d & data presentation

Success is what counts. 34

Achieving the Dream Institutional Change Principles

1. Committed leadership

CEO and leadership team

actively support efforts to

improve student learning and

completion

2. Culture of evidence

Colleges routinely analyze

student data to assess progress

and outcomes

3. Broad engagement

Faculty, staff, students, and

community stakeholders

participate in efforts to improve

student success

4. Systemic institutional

improvement

Colleges orient all planning and

activities around student

success agenda

Page 35: At d & data presentation

Success is what counts. 35

Roles of the Core and Data Teams

Broadly representative with key faculty involved

Thorough understanding of College data and assessment of initiatives

Guiding team for discussion, prioritization, implementation of improvements

Crucial communication link to larger communities

Broadly representative with key faculty involved

Collect, disaggregate, and study data; call for additional information

Provide support to the Core Team

Aid in establishment of appropriate assessment of all initiatives

Core Team Data Team

Page 36: At d & data presentation

What’s Next?

Page 37: At d & data presentation

Success is what counts. 37

Next Steps, Timeline and Deliverables

Fall Semester 2011

Look at Qualitative Data via focus groups and surveys to identify the underlying factors impeding student success (the why)

Examining existing policies and practices

Diagnose Causes of Problems

Disseminate Findings and Hold Additional Conversations

Prioritize Problem Areas to Address

Page 38: At d & data presentation

Success is what counts. 38

Next Steps, Timeline and Deliverables

By August 31: Establish Core and Data Teams

Fall Semester 2011: Engage Key Stakeholders Schedule “Courageous Conversations” to reflect on

the Quantitative Data (the what) Identify Key Issues and Achievement Gaps

Page 39: At d & data presentation

Success is what counts. 39

Next Steps, Timeline and Deliverables

Spring Semester 2012 Set Priorities, Goals and Measurable Outcomes Review Best Practices Attend the ATD Strategy Institute Develop Strategies (Interventions) to Address

Underlying Factors Impeding Student Success (Summative Goal: Achieve Increases in Student Success Outcome Measures)

Submit Final Version to MDC by May 15, 2011 July 2012 – June 2013

Implement and Evaluate Plan

Page 40: At d & data presentation

Q & A