The 21st Century GED Assessment System OVAE...
Transcript of The 21st Century GED Assessment System OVAE...
The 21st Century GED® Assessment System
GED ® Testing Service Presenters• Nicole M. Chestang, Executive Vice President, • Martin D. Kehe, Vice President, Product
Management• Debi Faucette, Senior Director, Field Outreach, • Tracy Gardner Senior Director, Assessment
Services
2
The BIG Announcement!!
“American Council on Education and Pearson to Overhaul GED” Inside Higher Ed, March 15, 2011
“GED Exam Will Be Computerized before New Version is Unveiled in 2014” Youth Today, March 16, 2011
4
The GED Testing Service®
DOB: March 11, 2011
Focus: Adult learners
Mission: To achieve the vision of the GED21st Century Initiative
Commitment: To ensure that more adults become career and college ready
5
About Us
• We believe that education transforms lives• We share your sense of urgency about the
crisis in educational attainment• We know that adult learners are integral to any
strategy designed to improve attainment• We know that partners are critical to realizing
effective, large-scale change
7
11
The GED® Reality
More than 39 million U.S. adults without a high school credential
10.5 Million are age 18-34
1.3 million U.S. high school dropouts annually
~ 770,000 GED®
Candidates
~ 472,000credentials
11
12
What’s Needed
• A new test that certifies not only high school equivalence but also career and college readiness
• An integrated system in which testing plays an important role but as a transitional step to college or career opportunities
• Diagnostics and additional tools—to provide more information to candidates and adult educators to drive preparation
• Technology-based delivery platforms (CBT) to ease access and capacity issues
The GED Testing Service’s Response
• Pivotal decision to cancel the 5th Edition GED® test (Sept. 2009)
• Engaged with the Bridgespan Group in market evaluation and strategic planning process
• Initiated a pilot of computer-based testing in 11 States
Outcome: GED® 21st Century Initiative, a holistic framework focused on adult learners that facilitates the transition to careers and college
13
The GED 21st Century Initiative Goal
Nationally AccessiblePreparation Programs
Next-genGEDExam
Post-testTransitionNetwork
Facilitate development of broadly accessible, multi-platform, accelerated approach to learning
Test aligned with CCSS & other state and int’l standards,
certifying CCR
Foster creation of a comprehensive network for successful transition to PSE & career opportunities
14
The GED 21st Century Initiative’s Goal:Facilitate pathways to achieve career & college
readiness and increase PSE attainment & career success
PerformPrepare Progress
15
PerformPrepare Progress
GED Readiness
Assessment
Demonstrate preparation for career and PSE
Pathways to instructional
system
Attain PSE credential
and/or career success
Connect to pathways to career and
PSE
Diagnostic post-
assessment
Customized curriculum &differentiated
instruction
• Enroll & persist in PSE to attain credential
• Access family-sustaining careers
• Receive information, counseling, or other supports to enroll in PSE or enter career
• Determine readiness for next-gen GED exam
• Assess learning gains and tailor ongoing instruction
• Take GED diagnostic assessment to identify learning needs
• Identify long-term PSE/career goals
• Take next-gen GED exam and earn credential
Diagnostic pre-
assessment
• Receive customized curriculum
• Access quality, tailored instruction
The GED 21st Century Initiative’s Goal:Facilitate pathways to achieve career & college
readiness and increase PSE attainment & career success
To• Content aligned to 1999 high school
curriculum
• Passing standard empirically setbased on norm-referencedperformance of graduating high school seniors
• Non-standardized paper-based test delivery channel
• Anecdotal proficiency gains
• A disjointed, fragmented system that challenges both adult learners and educators
• Rigorous content aligned to Common Core State Standards (CCSS), & other state and international standards
• Proficiency levels based on criterion-referenced performance standards for both high school and college/career readiness
• Standardized computer-based test delivery channel
• Accelerated proficiency gains
• Comprehensive, easily accessible system of supports that empower both adult learners and educators
From
Evolution of the GED® Program
16
2011 Deliverables
• 2002 Series continues• Operational CBT begins• Assessment Development
– Test blueprint– Performance levels developed
• Accelerated learning pilots• GED Marketplace Portal launch
18
2012 Deliverables
• 2002 Series begins to wind down• CBT expands to additional markets• Assessment Development
– Item development – Field testing
• Accelerated learning pilots• 2014 Test Content and Instructional
requirements shared with the field• Continue to build GED Marketplace Portal
19
2013 Deliverables
• 2002 Series comes to a close• CBT widely available • 2014 GED assessment system launch: GED
Readiness Test• Accelerated learning pilots continue and
knowledge is shared with the field • GED Marketplace Portal continues to develop• GED Transition Network launched
20
2014: The Dawn of the Next Generation GED® Assessment System
It’s a brand new day for adult learners
22
25
Chief Examiner Role
Work-Time Ranges0 – 25%
26 – 50%
51 – 75%
76 – 100%
% of CEs in Work-Time Range59.9%
17.4%
7.5%
15.1%
Testing Availability
• Test centers most often test no more than 30 days per year
• Testing on weekdays during the daytime
• 82% of test centers reported no waiting lists but,
– Significant waiting lists in some jurisdictions– ANY wait is significant for prepared test-
takers
26
Insights from the Market Research
• GED® testing is offered largely on a part-time basis
• 75% of centers reported that they could test at least 100 more candidates per year = another 1.3 million candidates
• Weekday, day-time hours = significant challenges for working adults to schedule convenient appointments
27
GED Testing: Operational Challenges
• Labor- and resource-intensive– People– Time– Money
• Test security • Availability (location, testing center hours, &
scheduling)• Wait time for credentials to be issued• Key processes are not yet automated
28
What CBT Is…and Is Not
• What CBT is…– Standardized mode of test delivery that
includes technology-based tools for data management, reporting and enhanced security procedures
• What CBT is not…– “Online” testing– An automated system that completely
replaces human interaction or judgment
29
Benefits for Test-Takers
• Rapid turnaround of results• More choices--when and where to test• Ease of registration• More consistent test-taker experience
All part of GED Testing Service’s commitment to serving more test-takers, and providing an accessible, valid and reliable testing process.
30
Why Now?
• Test-takers need increased access
– Only testing 2% of eligible population
– No marked increase in testing over past 8 years
• National & local governments requiring more efficient
processes
• Well-traveled road with many successful examples
• Prepares the way for the new GED assessment
31
Road to CBT
• May – October, 2010– 11-state pilot– Usability and Comparability Studies– Finding: CBT is usable and comparable
• November 2010 to June 2011– Operational CBT planning
• July/August 2011– Operational CBT launched
32
2011
• Data gathering • Planning process for first four jurisdictions• Initiate orientation program for next wave of
jurisdictions• Live CBT for lead jurisdictions• Evaluation
34
2012
• Data gathering and exploration continues for next wave of jurisdictions
• CBT network expands in jurisdictions• Orientation program continues • Ongoing evaluation and operational adjustments
35
2013
• Data gathering and exploration for final wave of jurisdictions
• CBT becomes dominant mode of delivery for jurisdictions that implemented in mid-2011 & early to mid-2012
• Project orientation program winds down• Evaluation program continues• Live CBT operational in all jurisdictions by end of
2013
36
Is the Field ready for CBT?• Almost 60% of test centers already have computers—23
computers on average• About the same percentage (60%) offer computer-based
testing (outside of GED tests)• 9 states have computers available in at least 75% of
their current test centers: Alaska, Arkansas, Hawaii, Kansas, Maine, North Dakota, Oklahoma, South Dakota and West Virginia
• California, Michigan, and Texas each had more than 50 centers with potentially available additional computers
• Yes, but we still have work to do…Source: Test Center Profile, 2010
37
PBT Cost Structure
PBT costs paid by jurisdictions– GED testing materials (as determined by GED Testing Service)– Staffing expenses: proctoring exams, registration, fee collection,
data management, reporting, transcript processing– Facilities expenses – Accommodations– Test scoring– Security: test and document handling and storage; staff training
and monitoring– Transcript and credential issuance
Average cost to the jurisdictions: ~ $150
39
Following the MoneyGED® testing is supported in varying degrees by:
Just because it’s not in the GED® Program budget, doesn’t mean that it’s not in someone’s budget
40
The Truth About Test-Taker Fees
• More than 46,000 GED® test candidates in all but five US states received grants or scholarships to test, totaling more than $3.3 million in 2009
• More than two-thirds of test centers get less than half of their funding from test fees
• Only one fourth of test centers rely solely on test fees for their support
• States varied in test-taker fees charged across test centers & in circumstances for fee waivers
Source: Test Center Profile, 2010
41
CBT Cost Structure – All Inclusive• Test battery leasing• Phone and internet registration• Fee collection• Test scoring • Instant unofficial score reports• Reporting • Data management• Data transfers• On demand testing• Test security• Proctoring• FacilitiesTest Center Compensation ~$40-$50 for 7.5 hour test
43
CBT: Fees to Test-Takers
Jurisdictions still set test-taker fees…however, the most needy test-takers won’t be forgotten
The GED Testing Service will be the lead sponsor in a consortium of partners who will create a foundation to support test-takers.
45
Why Aren’t There Plans for a National Rollout of CBT?• State policies
– Test-taker fees– Eligibility– Preparation requirements
• Funding models• Access concerns
– Location…location…location…– Community-college network– Corrections
46
49
Guiding Principles of the GED®
Assessment Design
• The GED® assessment targets will– Focus heavily on what matters most for postsecondary success– De-emphasize what is less important– Focus students and teachers on a powerful skill set that they
can deploy across the subject areas, as well as in careers and college
– Build on the strongest evidence in order to predict readiness incareer, college, and life
• The four subject-level assessments will reinforce core masteries (e.g., use of evidence) that strongly predict career and college readiness
50
The New GED® Assessment and Career and College Readiness Standards
• Raise the rigor of the GED® assessment by aligning with national & international career- and college-readiness expectations—e.g. CCSS
• Provide a framework for informing test development as well as provide clear guidelines for adult educators responsible for preparing test-takers
Assessment Design: An Inclusive ProcessWe will convene groups of stakeholders at various times in the process (over the next three years)
• Admissions Officers• Adult ED Instructors• Business Community • Community Colleges • Educational Policy• GED® Administrators• Higher Ed • High School/K-12 • Military• Psychometrics • Voc Ed/ trades
51
2011
• Assessment development partners identified• Content standards and assessment targets
finalized• Performance level descriptors drafted• Item development begins
53
2013
• Item Development and Field Testing for Diagnostic Test
• Release of GED Readiness Test v. 1.0• Construction of 2014 Operational GED Test
Forms
55
2011
• Computer-based testing tutorial available on the GED website (June)
• Assessment targets and draft Performance Level Descriptors shared with GED stakeholders (July)
• GED stakeholders involved in PLD refinement
57
2013
• Release of GED Readiness Test v. 1.0 (September)
• GED stakeholders involved in preliminary setting of Performance Standards (fall 2013)
59
61
The Four Subject-level Assessments
1. Literacy• Focus: demonstration of the ability to read and
comprehend a range of complex texts, especially complex nonfiction
• Writing tasks will require test takers to analyze given source texts, using evidence
2. Math• Focus on the material in CCSS that is most important
for a wide range of postsecondary outcomes • Includes material from the career and college ready
standards introduced in grades 6-8 and mastered in grades 9-12
62
The Four Subject-level Assessments
3. Science & 4. Social Studies
• Focus: Literacy and quantitative reasoning skills in context of the content
• Includes assessment of selected core content in each subject area
Literacy Content• 75% literary non-fiction; 25% will be literature.
• Text complexity ranging from high school thru college and career readiness levels.
• Focus on general academic vocabulary
• US Founding Documents and the “great conversation”that followed will be required texts
• All writing tasks will require the test taker to analyze a given source text or texts, using evidence drawn solely from the text(s).
63
Mathematics Content
• Quantitative Skills and Problem Solving• Algebraic Problem Solving• Elementary and Intermediate Algebraic
Techniques• Geometric Problem Solving• Using Graphs of Functions• Descriptive Statistics and Basic Inference
51
Rethinking Performance Levels & CredentialsNOW…The current exam
– Is pass-fail and – Doesn’t provide information about skills that
examinees demonstrate at different levels
FUTURE… Each content-area test in the exam will – Provide information to the test-taker and the test-
user (i.e., PSE and/or employers) about the specific knowledge, skills, and abilities that the candidate has demonstrated
65
Next Generation Assessment Performance Standards – An Illustration2002 Series GED® Tests
Passing Standard
Credential
No Credential
Next generation GED® assessment
Performance Standard 2 …tied to current level ofhigh school equivalencywith corresponding PLD
Performance Standard 3 …tied to college-readinesswith corresponding PLD
Performance Standard 1 …tied to pre-GED®
performance levelwith corresponding PLD
Scor
e Sc
ale Score
Scale
66
Rethinking Performance Levels & Credentials• What does the test-taker get?
– Information—which is central to improving performance
• What does the educator or employer get?– Information—A roadmap of current skills and
developmental needs, as measured against a career and college-ready framework—which is critical to planning for skills development
67
Instructions: Part One
• Identify key issues and themes• Time: 15 minutes• Assign a spokesperson• Note down the group’s ideas
69
Instructions: Part 2, Action Planning
• Time: 30 minutes• Select a theme or issue from the list• Brainstorm actions/plans that will help address the issue
or theme in the next 12-18 months• Questions for consideration:
– Who do you need to involve?– What decisions will need to be made?
• What additional information will you need?• What obstacles do you face?
• Each group will select 1 or 2 actions to share
70
Contact InfoNicole M. Chestang, Executive Vice [email protected]
Martin D. Kehe, Vice President, Product [email protected]
Debi Faucette, Senior Director, Partner [email protected]
Tracy Gardner, Senior Director, Assessment [email protected]
72