Developing a Persistence Index IUPUI Edition

21
· IUPUI · Developing a Persistence Index IUPUI Edition University Planning, Institutional Research, and Accountability April 19, 2007

description

Developing a Persistence Index IUPUI Edition. University Planning, Institutional Research, and Accountability April 19, 2007. Why A Persistence Index?. Traditional One-Year Retention and Six-Year Graduation Rates reflect progress of a small proportion of students. Why A Persistence Index?. - PowerPoint PPT Presentation

Transcript of Developing a Persistence Index IUPUI Edition

Page 1: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Developing a Persistence Index

IUPUI Edition

University Planning, Institutional Research, and AccountabilityApril 19, 2007

Page 2: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Why A Persistence Index?

Traditional One-Year Retention and Six-Year Graduation Rates reflect progress of a small proportion of students

CampusTraditional

CohortOther FTIC

Intercampus Transfer

External Transfer

Bloomington 79% 1% 7% 13%IUPUI 36% 8% 13% 43%East 33% 22% 12% 34%Kokomo 37% 15% 14% 34%Northwest 36% 18% 15% 32%South Bend 36% 17% 10% 38%Southeast 40% 11% 7% 41%

Page 3: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Why A Persistence Index?

Campuses differ as to the “persistence disposition” of students according to service mission

0%

10%

20%

30%

40%

50%

60%

70%

6 or fewer 6.5 to 11.5 12 to 15.5 16 or more

BL IN CO EA KO NW SB SE

Fall 2005 Undergraduate, Degree-Seeking Enrollment by Semester Credit Load

Page 4: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Why A Persistence Index?

Traditional measures not directly relevant to faculty and administrators within schools and programs Few fall semester, full-time FTIC students enter

directly into majors Students enter at varying points in time Many students change majors

Page 5: Developing a Persistence Index IUPUI Edition

· IUPUI ·

How The Persistence Index Works

Arrays ALL undergraduate, degree-seeking students according to factors related to persistence that reflect student input differences Credit Load Class Level Prior Academic Performance

Calculates persistence rate “within cell” Weights campus cells by university-wide

proportions

Page 6: Developing a Persistence Index IUPUI Edition

· IUPUI ·

The Control Factors

Prior analysis (CHAID) used to devise categories that maximize persistence rate differences

Prior academic performance FTIC: SAT or ACT Equiv – 900 or less; 910 to 1130; 1140+ Transfers: GPA of transfer courses – 2.87 or less; 2.88 to

3.66; 3.67 or higher

Table 2. Categories of the Persistence Index Control Factors and their Associated Persistence Rates

Fall Credit Load Rate Class Level Rate Prior Academics Rate6 or fewer 62% First Year 68% Low 71%6.5 to 11.5 71% Sophomore 80% Medium 82%12 to 15.5 82% Junior/Senior 87% High 89%16 or more 90%

Page 7: Developing a Persistence Index IUPUI Edition

· IUPUI ·

The Persistence Index Matrix – University-Wide Persistence Rates

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 47% 51% 58% 76%Medium 48% 54% 71% 83%High 48% 63% 83% 89%Low 59% 71% 77% 86%Medium 62% 71% 84% 90%High 63% 71% 86% 93%Low 69% 80% 87% 90%Medium 69% 80% 91% 93%High 73% 83% 94% 95%

*Excludes IPFW

Table 3. One-Year Persistent Rates for all Fall 2005 Indiana University Degree-Seeking Undergraduates* by Class Level, Credit Load, and Prior Academic Performance

First-Year

Sophomore

Upperclass

Credit LoadClass Level Acad. Bkgrnd

Page 8: Developing a Persistence Index IUPUI Edition

· IUPUI ·

The Persistence Index Matrix – Common Weights

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 2.2% 1.6% 6.3% 0.5%Medium 0.6% 0.7% 8.3% 2.1%High 0.2% 0.2% 3.5% 2.4%Low 2.2% 1.7% 5.0% 0.7%Medium 0.8% 0.9% 6.6% 2.0%High 0.2% 0.2% 3.1% 1.9%Low 4.0% 2.7% 7.7% 1.6%Medium 1.7% 1.6% 11.2% 3.9%High 0.6% 0.6% 7.0% 3.3%

*Excludes IPFW

First-Year

Sophomore

Upperclass

Table 4. Proportion of Fall 2005 IU Undergraduate, Degree-Seeking Students Falling into Each Cell of the Persistence Index Matrix

Class LevelAcad.

BkgrndCredit Load

Total N = 69,205

Page 9: Developing a Persistence Index IUPUI Edition

· IUPUI ·

The IUPUI Persistence Index Matrix

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 47% 50% 57% 76%Medium 48% 53% 63% 70%High 45% 70% 73% 81%Low 55% 64% 73% 80%Medium 63% 66% 80% 84%High 65% 69% 77% 88%Low 69% 80% 86% 90%Medium 71% 76% 89% 91%High 71% 80% 90% 96%

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

Sophomore

Page 10: Developing a Persistence Index IUPUI Edition

· IUPUI ·

The Persistence Index

Figure 1. The Unadjusted One-Year Persistence Rate and the Adjusted Persistence Index for IU Campuses

90%

74%

72%

66%

71%

70%

72%

73%

0% 25% 50% 75% 100%

BL

IN

CO

EA

KO

NW

SB

SE

"Unadjusted" Campus Persistence Rates

84%

77%

76%

72%

76%

75%

76%

76%

0% 25% 50% 75% 100%

BL

IN

CO

EA

KO

NW

SB

SE

The Adjusted Persistence Index

Page 11: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Persistence Matrix Comparisons

IUPUI (Indianapolis Only)

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 0% -1% -1% 0%Medium 0% -1% -8% -13%High -4% 6% -10% -9%Low -3% -6% -4% -6%Medium 1% -5% -4% -7%High 2% -2% -9% -5%Low 0% 0% -1% 0%Medium 2% -4% -2% -2%High -2% -3% -4% 1%

First-Year

Sophomore

Upperclass

Class Level

Acad. Bkgrnd

Credit Load

IUPU Columbus

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 7% -7% -6% -9%Medium 8% 1% -10% -24%High . 3% -16% .Low 12% 13% 8% -9%Medium 6% 7% -6% .High . . -16% .Low -1% 0% 7% 3%Medium 12% 9% -7% -2%High . 17% -14% .

Sophomore

Upperclass

First-Year

Class Level

Acad. Bkgrnd

Credit Load

19 Cells White16 Cells Red 1 Cell Green

4 Cells White11 Cells Red13 Cells Green 8 Cells Blank

Page 12: Developing a Persistence Index IUPUI Edition

· IUPUI ·

IUPUI School Comparisons

Figure 2. Unadjusted Persistence Rates and the Adjusted Persistence Index

92%

83%

79%

83%

82%

74%

94%

90%

81%

78%

74%

79%

95%

61%

0% 25% 50% 75% 100%

BUS

EDU

EGT

HER

INF

LBA

MED

NUR

PET

SCI

SCS

SPE

SWK

UCL

"Unadjusted" School Persistence Rates

77%

80%

81%

79%

72%

91%

85%

78%

74%

73%

75%

90%

67%

87%

0% 25% 50% 75% 100%

BUS

EDU

EGT

HER

INF

LBA

MED

NUR

PET

SCI

SCS

SPE

SWK

UCL

The Adjusted Persistence Rates

Page 13: Developing a Persistence Index IUPUI Edition

· IUPUI ·

IUPUI School Comparisons

BUS - Kelley School of Business

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . . .Medium . . 20% .High . . 22% .Low . . 20% .Medium . . 16% 16%High . . 4% 12%Low 18% 13% 9% 10%Medium 13% 11% 5% 1%High 1% 11% 3% -1%

Credit Load

First-Year

Sophomore

Acad. Bkgrnd

Class Level

Upperclass

MED - Medicine (Allied Health)

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . 32% .Medium . . . .High . . . .Low . . 27% .Medium . . 20% .High . . 23% .Low . . 14% 5%Medium 19% . 5% 9%High . . 10% 4%

Class Level

Acad. Bkgrnd

Credit Load

First-Year

Sophomore

Upperclass

SWK - Social Work

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . . .Medium . . . .High . . . .Low . . . .Medium . . . .High . . . .Low . . 9% .Medium . . 8% .High . . 10% .

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

NUR - Nursing

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . . .Medium . . . .High . . . .Low . . 27% .Medium . . 17% .High . . 23% .Low 3% -8% 11% 10%Medium -2% 4% 7% 4%High 9% 12% 8% 4%

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

Page 14: Developing a Persistence Index IUPUI Edition

· IUPUI ·

IUPUI School Comparisons (cont.)

HER - Herron School of Art & Design

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . 43% .Medium . . 7% 30%High . . 19% .Low -10% . -1% .Medium . 7% 2% .High . . -5% .Low 4% 8% 0% 10%Medium 7% 4% 6% 9%High . 10% 0% .

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

EGT - Engineering & Technology

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 11% 33% 21% .Medium 2% 37% 2% 1%High -17% . 12% -3%Low 8% 7% 6% 3%Medium 6% 12% 3% -1%High -1% -3% 10% -4%Low 5% 8% -1% -3%Medium 2% 7% 4% -1%High 2% 9% 2% 4%

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

PET - Physical Education & Tourism Management

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 9% 14% 3% .Medium . . 7% .High . . . .Low 5% 23% 8% 2%Medium . . 3% -6%High . . 1% .Low 6% 6% -1% 0%Medium -9% 15% -2% 3%High . . -3% 4%

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

SPE - Public and Environmental Affairs

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . -2% .Medium . . 4% .High . . -33% .Low 4% 24% 2% .Medium . . 6% 4%High . . . .Low -6% -3% 0% 1%Medium 3% 5% -3% 4%High 5% . 6% .

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

Page 15: Developing a Persistence Index IUPUI Edition

· IUPUI ·

IUPUI School Comparisons (cont.)

EDU - Education

6 or Fewer >6 - <12 12 - <16 16 or MoreLow . . 21% .Medium . . -2% 5%High . . -17% .Low -1% 13% 1% 10%Medium 26% -9% 1% -4%High . . -2% .Low -7% 1% 7% 7%Medium -7% -3% 3% 5%High . . 5% .

Credit Load

First-Year

Sophomore

Acad. Bkgrnd

Class Level

Upperclass

INF - Informatics

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 5% . 26% .Medium . . 18% .High . . . .Low -5% -2% 6% .Medium . 7% 8% .High . . 0% .Low -19% -7% 3% 10%Medium -5% 10% 3% 9%High -5% . -4% 4%

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

SCS - Continuing Studies

6 or Fewer >6 - <12 12 - <16 16 or MoreLow -6% -6% . .Medium . . . .High . . . .Low 1% 13% 6% .Medium 18% . -3% .High . . . .Low 1% 0% -2% -3%Medium 0% -3% -3% -19%High -3% -17% -13% .

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

Page 16: Developing a Persistence Index IUPUI Edition

· IUPUI ·

IUPUI School Comparisons (cont.)

LBA - Liberal Arts

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 13% 17% 0% .Medium 27% -16% -4% .High 10% . -12% -14%Low 22% 4% 5% .Medium 10% -4% 0% 0%High . . -16% 1%Low -1% -6% -8% -5%Medium -11% 0% -8% -8%High -2% -12% -11% -6%

Acad. Bkgrnd

Credit Load

First-Year

Sophomore

Class Level

Upperclass

SCI - Science

6 or Fewer >6 - <12 12 - <16 16 or MoreLow 23% . -2% .Medium . -3% 3% -15%High . . 1% -9%Low 18% 5% 1% 5%Medium -13% 11% 2% -4%High . . 4% 1%Low -2% -8% -4% -6%Medium 9% -9% -3% 2%High -14% -7% 1% 0%

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

UCL - University College

6 or Fewer >6 - <12 12 - <16 16 or MoreLow -6% -2% -4% -13%Medium -6% -1% -1% -3%High 3% -2% -3% 5%Low -8% -8% -7% -6%Medium -7% -8% -6% 1%High 10% -10% -7% -3%Low -18% -7% -12% -9%Medium -5% -15% -10% -9%High 9% -3% -10% 4%

Sophomore

Upperclass

Acad. Bkgrnd

Credit Load

First-Year

Class Level

Page 17: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Detailed Comparisons – Appendix D & E

Appendix D – Proportions of Students

Up

pe

rcla

ss

Lo

w A

ca

de

mic

Me

diu

m A

ca

de

mic

Hig

h A

ca

de

mic

6 or Fewer >6 - <12 12 - <16 16 or More

9

4

10

67

10

2

9

5

7

22

12

32

0%

4%

8%

12%

16%

20%

24%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=6.78

4

65

6 6

1

5

3

5

98

21

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=4.2

18 19

9

17 1613

8

1917

9

17 18

46

4

0%

10%

20%

30%

40%

50%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=10.7

3

5

21

3 3

8

1

6

3 32 2

0

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=2.1

43

4 3

54

3

5

2

5

7

4

21

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=3.0

5

2 3 3 34

1

4

2

4 34

2

1

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=2.424

17

7

1713 15 14

29

15 15

9

16

24

3

0%

10%

20%

30%

40%

50%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=10.8

4

5

2 23 3

7

2

54

23

1 0

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=2.2

10

10

2 2

01

01

21

0 00%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=0.8

2

0

21 1 1

02

01 1

0 10

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=0.9

74 4 5

7 5 4

12

37

14

7

1

0%

10%

20%

30%

40%

50%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=3.6

4

5

2 23 3

7

2

54

23

1 0

0%

2%

4%

6%

8%

10%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

C%=0.9

Page 18: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Detailed Comparisons – Appendix D & E

Appendix E – Within Cell Persistence Rates6 or Fewer >6 - <12 12 - <16 16 or More

Up

pe

rcla

ss

Lo

w A

ca

de

mic

Me

diu

m A

ca

de

mic

Hig

h A

ca

de

mic

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

87

63 6373

50

69 72 7568 70

6351

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=69.394

82

67

88

73 74 72 7380 77 73

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=80.595 93

87 86 8978

100 97

78 81 83 8695

74

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=85.7 100 9685

100

8595 100

84 86 9181

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=89.9

84

6474 79

6760

6963

8071 74

66

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=71.287

73

8881

8776 80

86

6774

81

61

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=76.394 92

8595 92

8194 96

85 86 86 8697

79

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=89.092 96

86100 100

83

100 95 90 93

72

9582

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=90.9

73 7367 70

80

5768

80

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=71.391

83

68

92 91

7464

77

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=80.492 95 93 89 86

79

100 9887 91

77

96 100

80

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=89.895 90

10090

100 10094 96 100

0%

20%

40%

60%

80%

100%

BU

S

ED

U

EG

T

HE

R

INF

LB

A

ME

D

NU

R

PE

T

SC

I

SC

S

SP

E

SW

K

UC

L

CRt=96.0

Page 19: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Limitations

Control factors not perfect Validity and reliability issues Other important input difference factors not

accommodated (e.g., campus residence status)

Small cell problems Imputation fills cells based on overall school

rate relative to overall campus rate Can not drill down too far

School level may be as far as possible, unless multiple years used for big departments

Page 20: Developing a Persistence Index IUPUI Edition

· IUPUI ·

Uses

Finding pockets and patterns Filling in the void between first year

retention and six year graduation points Stimulating dialogue at the all levels

(campus, school and possibly programs)

Page 21: Developing a Persistence Index IUPUI Edition

· IUPUI ·