District Assessment Coordinators and WaKIDS WebinarOctober 14, 2013 1.
Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability...
-
Upload
dwayne-ramsey -
Category
Documents
-
view
216 -
download
0
Transcript of Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability...
![Page 1: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/1.jpg)
www.FLDOE.org1
Bureau of K-12 Student Assessment
District Assessment and Accountability Coordinators Annual Meeting
![Page 2: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/2.jpg)
www.FLDOE.org2
Introductions
Bureau of K-12 Student AssessmentAdministration
• Susie Lee, Director• Catherine Altmaier• Jenny Black• Kira Bland• Lisa Nash• Becky Stephens
2
![Page 3: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/3.jpg)
www.FLDOE.org3
Introductions
Bureau of K-12 Student AssessmentScoring and Reporting
• Dr. Qian Liu, Director• Gabriel Colorado• Marilyn Dwyer
3
![Page 4: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/4.jpg)
www.FLDOE.org4
IntroductionsAmerican Institutes for Research (AIR) • Kevin Murphy, Director, State Programs• Jeff Burger, Technical Director• Ghi Crisafulli, Assessment Communications Manager• Danni Greenberg, Program Manager• Eugenia Kim, Senior Score Reporting Project Manager• Margaret Won, Scoring & Reporting Specialist
Data Recognition Corporation (DRC)• Pete Tressel, Director, State Programs• Angie Karn, Senior Project Manager• Mike Kulzer, Senior Project Manager4
![Page 5: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/5.jpg)
www.FLDOE.org5
Introductions
Pearson • Andy Messenger, Vice President, State Services• Chad Curtis, Senior Program Manager, Scoring & Reporting• Leann Spaight, Program Manager, Computer-Based Testing• Amanda Pepmiller, Program Manager, Test Development• Paul Arens, Director, Online Testing/Core Engineering
5
![Page 6: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/6.jpg)
www.FLDOE.org6
Question Form• If you have questions during the meeting today that
are not addressed, you may submit them in a Google form.
• https://docs.google.com/forms/d/1z57ZMYIW309YcJKqkJvztI54LIkkeHTeqxD3FPW6NpU/viewform
6
![Page 7: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/7.jpg)
www.FLDOE.org7
Communication Monthly Summary—A Success!
Provides a list of all communications sent from our office in the previous month.
Provides a PDF file of all communications.
Provides important dates for the next month.
Provides contact information for the K-12 Student Assessment team members.
7
![Page 8: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/8.jpg)
www.FLDOE.org8
2015 Standard Setting Updates
2014 Civics End-of-Course Assessment Standard Setting Update
![Page 10: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/10.jpg)
www.FLDOE.org10
Important Dates• Achievement Level Description (ALD) Panel:
April 28–May 1 • Hotel Duval, Tallahassee, Florida
• Educator Panel: August 31–September 4, 2015• Grand Cypress, Orlando, Florida
• Reactor Panel: September 10–11, 2015• Grand Cypress, Orlando, Florida
![Page 11: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/11.jpg)
www.FLDOE.org11
Achievement Level Description Panel• April 28–May 1, 2015• Four-day workshop• Forty-two panelists• Described achievement levels for content standards
by grade and subject
![Page 12: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/12.jpg)
www.FLDOE.org12
Standard Setting Educator Panel• August 31–September 4, 2015• Five-day standard-setting workshop• Four rounds of standard setting• About 300 panelists• Seventeen rooms setting standards concurrently
• Recommending cut scores based primarily on content, though impact and benchmark data is reviewed after the first two rounds of judgments
![Page 13: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/13.jpg)
www.FLDOE.org13
Standard Setting Reactor Panel• September 10–11, 2015• Two-day meeting composed of
• community/education organization leaders• state university leaders• business leaders• school board members • superintendents
• Review educator panel recommended cut scores and impact data
• Two rounds of judgment• About 20 panelists
![Page 14: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/14.jpg)
www.FLDOE.org14
• Standard setting becomes necessary whenever any of the following occur:
• New test• Curriculum updates• Blueprint changes• ALDs change
• FSA: new assessments for adopted content standards
When Is Standard Setting Necessary?
![Page 15: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/15.jpg)
www.FLDOE.org15
• A process of deriving levels of performance on educational or professional assessments, by which decisions or classifications of persons will be made (Cizek, 2006)
• Test scores can be used to group students into meaningful achievement levels
• Standard setting is the process whereby we draw the lines that separate the test scores into various achievement levels
What Is Standard Setting?
![Page 16: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/16.jpg)
www.FLDOE.org16
Standard-Setting Method• Bookmark Method—One of a number of
approaches available for standard setting• One of the most widely used and most defensible methods• Research-based procedure• Used in many state assessment programs• Proven to be technically sound in litigation
Mitzel, H. C., Lewis, D. M., Patz, R. J. & Green, D. R. (2001). The Bookmark procedure: Psychological perspectives. In: G. Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives. Mahwah, NJ: Erlbaum.
![Page 17: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/17.jpg)
www.FLDOE.org17
We’ve Done This Before…
1998: • Reading and Mathematics Achievement Levels approved for grades 4, 5, 8, and 10
2001: • Reading and Mathematics Achievement Levels approved for grades 3–10
• Grade 10 FCAT Reading and Mathematics passing scores established
2011:• FCAT 2.0 Reading (grades 3–10) and Mathematics (3–8) Achievement Levels approved
• Algebra 1 EOC Assessment Achievement Levels approved
• Grade 10 FCAT 2.0 Reading and EOC assessment passing scores established in rule as the minimum score in Achievement Level 3
2012:• FCAT 2.0 Science (grades 5 and 8) Achievement Levels approved
• Biology 1 and Geometry EOC Assessment Achievement Levels approved
2013:• U.S. History EOC Assessment Achievement Levels approved
2014:
• Civics EOC Assessment Achievement Levels approved
![Page 18: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/18.jpg)
www.FLDOE.org18
Standard Setting – Next Steps • Rule Development Workshops
• Broward County – September 15• Orange County – September 16• Leon County (Webcast) – September 17
• Rule workshop information and public feedback form will be available on the FDOE website at http://www.fldoe.org/accountability/assessments/k-12-student-assessment/stard-setting.stml
![Page 19: Www.FLDOE.org 1 Bureau of K-12 Student Assessment District Assessment and Accountability Coordinators Annual Meeting.](https://reader030.fdocuments.us/reader030/viewer/2022032313/56649e6c5503460f94b6afc1/html5/thumbnails/19.jpg)
www.FLDOE.org19
www.FLDOE.org
THANK YOU!