1 Getting the Most from your ACT Explore Reporting Package.

1

Getting the Most from your ACT Explore Reporting Package

2

Meredith Townley

Trainer, Learning Management TeamPhone: 319.333.9430

[email protected]

33

O U R M I S S I O NHelping people achieve education and workplace success

O U R V A L U E SExcellence

Diversity

Leadership

Empowerment

Learning

Sustainability

44

Workshop ObjectivesIntroduction

Describe ACT’s definition of college and career readiness and ACT’s K-Career Continuum

Find key data points in the ACT Explore Student and Summary Profile Reports

Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels

5

Defining College and Career Readiness

66

ACT’s Definition of College and Career Readiness

College and Career Readiness is the level of preparation a student needs to be equipped to enroll and succeed – without remediation – in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.

www.act.org/commoncore

77

In the next decade, nearly two-thirds of new jobs created in the U.S. will require

some post-secondary education or considerable on-the-job training.

Preparation for College and Career

Prepare all students for success, no matter which path they choose after graduation.

http://www.act.org/research/policymakers/reports/workready.html

88

MEASURING STUDENT PROGRESS TOWARD READINESS IMPROVING COURSE RIGOR

EXPLORE

8th and 9th grade

curriculum-based educational and career planning

program

PLAN

10th grade curriculum-based educational and career planning

program

The ACT

11th and 12 grade

curriculum-based assessment for

learning outcomes

ENGAGE

Middle and high school

assessments that measure

behavioral factors of academic success

QualityCore

Research-driven solutions for

strengthening curriculum

ACT K through Career SolutionsK-12 Components

99

MEASURING STUDENT PROGRESS TOWARD READINESS IMPROVING COURSE RIGOR

EXPLORE

8th and 9th grade

curriculum-based educational and career planning

program

PLAN

10th grade curriculum-based educational and career planning

program

The ACT

11th and 12 grade

curriculum-based assessment for

learning outcomes

ENGAGE

Middle and high school

assessments that measure

behavioral factors of academic success

QualityCore

Research-driven solutions for

strengthening curriculum

ACT K through Career SolutionsK-12 Components

3rd – 10th grade Vertically articulated, standards-

based system of summative, interim, and classroom-based

assessments

1010

25

3632

Longitudinal AssessmentsCommon Score Scale Relationship

1111

Longitudinal AssessmentsACT Curriculum-Based Assessments

1212

ACT’s College Readiness Benchmarks

Test College Course 8th Grade 9th Grade

English English Composition 13 14 15 18

Math College Algebra 17 18 19 22

Reading Social Sciences 16 17 18 22

Science Biology 18 19 20 23

Empirically derived

50% likelihood of achieving a B or higher or about a 75% likelihood of achieving a C or higher in the corresponding credit-bearing college course

13

Condition of College and Career Readiness, 2013National Results

Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2013

http://www.act.org/research/policymakers/cccr13/readiness4.html

14

Condition of College and Career Readiness, 2013Arizona Results

Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2013

http://www.act.org/newsroom/data/2013/states/pdf/Arizona.pdf

15

Condition of College and Career Readiness, 2013Arizona Results

Percent of 2012–2013 ACT Explore–Tested 8th Graders Meeting ACT College Readiness Benchmarks

http://www.act.org/newsroom/data/2013/states/pdf/Arizona.pdf

1616

Student Score Report

17


Header

3. Career Exploration

1. Academic Achievement & Education Planning

2. Intervention Planning

18

1. Academic Achievement and Education Planning: Your ScoresStudent Scores and Norms

19

1. Academic Achievement and Education Planning: Your ScoresStudent Scores and Norms

20

1. Academic Achievement and Education Planning: Your PlansCollege Readiness

21


22


23

1. Academic Achievement and Education Planning: Your ScoresEstimated Scores on ACT Plan or The ACT

24


25


• Reported Needs

• Core Coursework

• Plans

26

2. Intervention Planning: Your SkillsItem Response Summary and Suggestions for Improvement

27


28


29

3. Career Exploration: Your Career PossibilitiesWorld of Work

30


34


35


3636

Student Score ReportDissemination

What happens next?– Teachers/counselors learn to interpret

individual student results– School administrators should be aware of

individual student results– Teachers/counselors review results with

students– Teachers/counselors review results with

parents

37

Student Resources

www.explorestudent.org

http://www.act.org/explorestudent/

3838

Profile Summary Report

Aggregates data from Student Score Reports

Identifies if students are on target to be college and career ready

Shows if coursework aligns with career interests and educational plans

3939

Frequency Distribution TableProfile Summary Report: Table 1a

How do the ACT Explore scores of our students compare with those of students nationally?

40

Benchmark

191 Total Students

Frequency Distribution TableProfile Summary Report

41

Students on target to be college ready

38 (20%) Students Below Benchmark

53 (28%) Students Above Benchmark

100 (52%) Students on the Cusp

44 in danger of slipping

41 within 2 points of benchmark

Benchmark

Students on the cusp

191 Total Students

Students in need of intervention

Frequency Distribution TableProfile Summary Report

4242

ACT’s College Readiness Standards

Identify the knowledge and skills students are likely to demonstrate at various score levels on each academic test.

Help interpret what the scores earned on ACT Explore, ACT Plan, and The ACT mean.

Direct link between what students have learned and what they are ready to learn next.

http://act.org/standard/

43

And statements thatprovide suggestions to

progress to a higher levelof achievement

Statements that describe what students are likely to know and be able to do...

http://act.org/standard

4444

College Readiness Standard Score RangesProfile Summary Report: Table 1c

How does your local “% At or Above Benchmark” compare to the national %?

52%/64%

4545

College Readiness Standard Score RangesProfile Summary Report: Table 1c

In which ranges are the majority of your students?

Given these score ranges, in which College Readiness Standards are your students most proficient?

16-19

13-15

46

http://act.org/standard

4747

Scores by Gender, Race, and Ethnic BackgroundProfile Summary Report: Table 2

Where are the instructional gaps?

4848

What are the future educational plans of your students?

How can you encourage and support these educational plans?

Educational PlansProfile Summary Report: Table 3

4949

Educational Plans and NeedsProfile Summary Report: Table 4

What areas of need have students’ expressed?

Are we providing programs or services to meet our students’ needs?

5050

Profile Summary ReportAdditional information

Profile Summary Report also includes:

– Relation between scores and career interests (Tables 5a and 5b)

– Local Items (Table 6)

5151

Item Response Summary Report

Provides data on the item-by-item performance of your students.

Is a very useful tool for curriculum review when used along with the test booklet.

52


53


54


Given your curriculum, is the percentage of your report group answering each item correctly and consistent with your expectations? Is a large percentage of your report group choosing incorrect response options?

5555

Application ExerciseItem Response Summary Report

Circle the *asterisked numbers (correct answers) for each question.

Use your highlighters to mark only the circled numbers (make a key):

No Mark 75%+

Green 50-74%

Yellow 25-49%

Pink 0-24%

56

Replace image with what is in the workbook and fix the color coding key to match

Color-Code No Mark 75%+ Green 50-74% Yellow 25-

49% Pink 0-24%

5757

Application ExerciseAnalysis

Look for patterns:

Dramatic differences from the reference group

High percentages clustered around a wrong answer

High percentages of omitted questions

Do any of these occur more frequently for some domains than others?

58

Dramatic Difference from

Reference Group

59

Clustered on wrong answer

60

High

Perce

ntag

e O

mitt

ed

61

www.act.org/standards

Next Steps: Curriculum Alignment Resources at ACT

• Assists in organizing teaching practices• Offers sequence for delivering content • Provides clear scope of what must be taught to all

students

http://www.act.org/standards

6262


Examples of test items by Strand by Score Range

Suggestions for strategies and assessments by Strands

Special Section: Using assessment information to help support low-scoring students

www.act.org/standard/guides/explore/index.html

http://www.act.org/standard/guides/explore/index.html

63

Examples of Test Items by Score Range

www.act.org/standard/guides/explore/index.html

http://www.act.org/standard/guides/explore/index.html

6464


Curriculum Review Worksheets

http://act.org/standard/instruct/pdf/CurriculumReviewWorksheets.pdf




6565

Your District’s Curriculum Compared to the College Readiness Standards





66

Early Intervention Rosters

School-level reports that identify students who fall into three categories:

Roster 1: Educational Plans Roster 2: Below 10th percentile (ACT Explore only) Roster 3: Need Help

6767

ACT Plan Early Intervention RostersRoster 1: Early Identification

Roster 1: Students indicating they do not plan to finish high school or have no post-high school educational plans

6868


6969


7070

ACT Plan Early Intervention RostersRoster 2: Coursework Intervention

– Roster 2:

ACT Explore: Students scoring below the national 10th percentile

ACT Plan: students with

2a) composite score of 16 or higher who reported they have no plans to go to college

2b) reported that they plan to attend college but earned a composite score of 15 or less, or reported that they do not plan to take college core coursework.

7171

ACT Plan Early Intervention RostersRoster 2: Coursework Intervention

Roster 2: ACT Explore: Students scoring below the national 10th percentile

7272

Early Intervention RosterRoster 3: Need for Assistance

– Roster 3: Students who expressed a need for help in a particular area

Are we providing programs or services to meet our students’ needs?

7373

Additional Resources

Contact Customer Service: 877-789-2925

Educator Resources:www.act.org/explore

Student Resource: www.explorestudent.org

College Readiness Standards: www.act.org/standard

7474

Questions

Questions?

1 Getting the Most from your ACT Explore Reporting Package.

Documents

Transcript of 1 Getting the Most from your ACT Explore Reporting Package.