Slide 1

Online Testing Programs EDCI 750 Emerging Technologies Spring 2012 Presenters: Kris Oswald Shaun Rosell Slide 2 Introduction What are Online Testing Programs? Websites or applications that allow instructors to share assessments using various platforms Used in various environments, not just education Lower education Higher education Corporate Government Slide 3 Settings Education Formative assessment Summative assessment Standardized testing Preparatory or practice tests Self-assessment Corporate Customer and employee training Competency / compliance training Employee skills evaluations Multiple offices and locations Slide 4 Types Create your own assessment and upload Use online database to generate questions for assessment Use other databases to generate questions for assessment and upload Use a combination of the above methods Computer Adaptive Testing (CAT)* Slide 5 Uses Create assessment Share assessment Administer assessment Grade assessment Statistical analysis for assessment Provide information for individualized learning Slide 6 Computer Adaptive Testing (CAT) Adjusts questioning based on student responses to identify the level of the student Tailored to each student More accurate than traditional testing Provides educators with better information More efficient than traditional testing More secure than traditional testing Slide 7 Examples of Use Online Testing and Computer Adaptive Testing Pearson ALEKS Assessment Technology Incorporated (ATI) Slide 8 Create tests from database library. Slide 9 Example of a written test question. Example of a written test report. Slide 10 Monitoring report to track students during test. Slide 11 Class report including progress on particular topics. Slide 12 Class report including time spent on the program. Slide 13 Class report including student knowledge of individual topics. Slide 14 Student performance report. Slide 15 ePortfolios Display student growth and achievement Allow students to reflect on learning Multiple types Current work Showcase of best work Work that demonstrates mastery of specific learning objectives Slide 16 Rubrics for Assessment Needed for written responses, oral assessments, and ePortfolios Provide equitable grading Allow students to know standards before composing responses Slide 17 Benefits No technical or programming skills needed Minimal management needed Assessments are customizable Assessments can be shared in any setting Track students throughout test Assessments instantly graded Instant reports and analysis Saves paper X Slide 18 Challenges Creating easy-to-use interface and navigation Creating interface that does not distract from content Student variability within and across age ranges Accommodating students with disabilities Control over who is taking the testing Slide 19 Paper vs. Computer-based Mixed results on test mode effect Factors Content familiarity Computer familiarity Gender Race Computer-based assessment success depends on usability and usefulness Computer-based assessment has potential to be more sophisticated and a more accurate measure Slide 20 Common Core State Standards (CCSS) SMARTER Balanced Assessment Consortium (SBAC) and Partnership for Assessment of Readiness for College and Careers (PARCC) Developing next-generation assessments aligned to the CCSS that: Inform instruction Guide interventions Help target professional development Ensure accurate measurement of student progress PARCC: http://www.parcconline.org/http://www.parcconline.org/ SBAC: http://www.smarterbalanced.org/http://www.smarterbalanced.org/ Slide 21 Summary When the usability and usefulness meets the needs of individuals, online testing programs: Provide opportunity for sophisticated assessment administered in various settings Provide instant feedback that can help educators individualize instruction Can be used to help students progress to college or careers Slide 22 Online Testing Program Companies Hosting Sites ClassMarker HostedTest OnlineTesting.net Online Testing and Databases Assessment Technology Incorporated (ATI) Oxford University Press ProProfs Respondus Computer Adaptive Testing ALEKS ETS Slide 23 References Clariana, Roy and Wallace, Patricia (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. Retrieved March 03, 2012 from http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep /Paper_vs_Computer_Assessments.pdf http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep /Paper_vs_Computer_Assessments.pdf Electronic portfolios. In Wikipedia. Retrieved March 08, 2012 from http://en.wikipedia.org/wiki/Electronic_portfolio http://en.wikipedia.org/wiki/Electronic_portfolio Harms, Michael and Adams, Jeremy (2008). Usability and design considerations for computer-based learning and assessment. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39- 6235-4E9F-8AB8- F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerB asedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and _Design_Considerations http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39- 6235-4E9F-8AB8- F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerB asedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and _Design_Considerations Clariana, Roy and Wallace, Patricia (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. Retrieved March 03, 2012 from http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep /Paper_vs_Computer_Assessments.pdf http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep /Paper_vs_Computer_Assessments.pdf Electronic portfolios. In Wikipedia. Retrieved March 08, 2012 from http://en.wikipedia.org/wiki/Electronic_portfolio http://en.wikipedia.org/wiki/Electronic_portfolio Harms, Michael and Adams, Jeremy (2008). Usability and design considerations for computer-based learning and assessment. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39- 6235-4E9F-8AB8- F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerB asedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and _Design_Considerations http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39- 6235-4E9F-8AB8- F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerB asedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and _Design_Considerations Slide 24 References Continued Rubrics. In Kennesaw State University. Retrieved March 08, 2012 from http://edtech.kennesaw.edu/intech/rubrics.htmhttp://edtech.kennesaw.edu/intech/rubrics.htm Way, Walter D (2006). Practical questions in introducing computer adaptive testing for k-12 assessments. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/EC965AB8- EE70-46E5-B1A5- 036BE41AB899/0/RR_05_03.pdf?WT.mc_id=TMRS_Practical_Que stions_in_Introducing_Computerized http://www.pearsonassessments.com/NR/rdonlyres/EC965AB8- EE70-46E5-B1A5- 036BE41AB899/0/RR_05_03.pdf?WT.mc_id=TMRS_Practical_Que stions_in_Introducing_Computerized Way, Walter D., Lin, Chow-Hong, and Kong, Jadie (2008). Maintaining score equivalence as tests transition online: issues, approaches, and trends. Retrieved March 03, 2012 from http://www.pearsonassessments.com/hai/images/tmrs/Maintaining_ Score_Equivalence_as_Tests_Transition_Online.pdf http://www.pearsonassessments.com/hai/images/tmrs/Maintaining_ Score_Equivalence_as_Tests_Transition_Online.pdf Slide 25 References Continued Way, Walter D., Davis, Laurie L., and Strain-Seymour, Ellen (2008). The validity case for assessing direct writing by computer. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/CAF6FF48- F518-4C68-AF2F- 2959F902307E/0/TheValidityCaseforOnlineWritingAssessments.pdf ?WT.mc_id=TMRS_The_Validity_Case_for_Assessing_Direct http://www.pearsonassessments.com/NR/rdonlyres/CAF6FF48- F518-4C68-AF2F- 2959F902307E/0/TheValidityCaseforOnlineWritingAssessments.pdf ?WT.mc_id=TMRS_The_Validity_Case_for_Assessing_Direct Slide 26 Resources 1.Educause http://www.educause.edu/ELI/LearningPrinciplesandPractices/ITAssess ment/12398 2.Web 2.0 Testing Tools http://web20teach.blogspot.com/2008/05/top-5-quiz-generators-for- online.html 3.Easy TestMaker http://www.easytestmaker.com/default.aspx 4.EdTech Toolbox: Web 2.0 Tools by Task Surveys, Quizzes, and Polls http://edtechtoolbox.blogspot.com/p/web-2-tools-by-task.html 5.Engrade http://www.engrade.com/ Slide 27 Resources Continued 6. Fifty Sneakers http://www.fiftysneakers.com/ 7.Jeopardy Labs http://www.jeopardylabs.com/build 8.Free Rice http://www.freerice.com 9.Digi[cation] http://www.digication.com 10.Gooru http://www.goorulearning.org Slide 28 Resources Continued 11.Christopher Longs ePortfolio Blogging Scoring Rubric http://www.personal.psu.edu/cpl2/blogs/cplportfolio/Blogging%20Scorin g%20Rubric.pdf 12.University of Alaska-Southeast Online Discussion Rubric http://www.uas.alaska.edu/sitka/IDC/resources/onlineDiscussionRubric. pdf 13.Penn State University - VoiceThread Rubric http://voicethread.psu.edu/2011/06/rubrics-for-using-voicethread-in- your-course.html 14.University of Wisconsin-Stout School of Education Assessment Rubrics http://www.uwstout.edu/soe/profdev/rubrics.cfm 15.iRubric http://www.rcampus.com/indexrubric.cfm