Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of...
Transcript of Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of...
![Page 1: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/1.jpg)
Adaptive Training and Testing Techniques
Matthew Reed
Office of Ground Water and Drinking Water
August 25, 2020
![Page 2: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/2.jpg)
Water Sector Challenges During COVID-19 Pandemic
• Operator Training for CEUs
• In-Person Training Lacking
• CEUs Not Always Accepted by Primacy Agency for Online Training
• Operator Testing for Certification and Renewals
• In Person Testing Availability
• Virtual Testing Options
2
![Page 3: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/3.jpg)
Web Based Training For Operators
![Page 4: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/4.jpg)
≠The Challenge
![Page 5: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/5.jpg)
Involve The Stakeholders• State Primacy Agency
– course approval
– attendance tracking
• Instructors
– willingness vs. ability
• Prospective Students
– “if you build it they will come”
![Page 6: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/6.jpg)
Select a Webinar Platform
Considerations:
• The learning curve – for instructors & attendees
• Desired features - open or closed?
• Cost
• Other considerations
![Page 7: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/7.jpg)
Microsoft TeamsWe already had Office365 on our
computers, so no additional costs.
![Page 8: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/8.jpg)
Lessons We’ve Learned (the hard way)
Good Internet Connection!!!
![Page 9: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/9.jpg)
Lessons We’ve Learned (the hard way)
Technical Support
![Page 10: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/10.jpg)
Lessons We’ve Learned (the hard way)
The Rock StarInstructor
![Page 11: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/11.jpg)
Lessons We’ve Learned (the hard way)
Designated Internal Support
![Page 12: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/12.jpg)
Lessons We’ve Learned (the hard way)
Vary Training Styles
Interactive
Video
Demonstrate
Lecture
![Page 13: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/13.jpg)
Lessons We’ve Learned (the hard way)
Eliminate Distractions
![Page 14: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/14.jpg)
Lessons We’ve Learned (the hard way)
Eliminate Distractions
![Page 15: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/15.jpg)
Lessons We’ve Learned (the hard way)
It Happens
MOST OF ALL HAVE FUN!
![Page 16: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/16.jpg)
Donald Papai
Apprentice Training Director
Alliance of Indiana Rural Water
PO Box 789
Franklin, IN 46131
Tel: (317) 789-4200
Email: [email protected]
Thank You!
![Page 17: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/17.jpg)
August 25, 2020
REMOTE PROCTORING: Iowa’s Golden Ticket for Exam Delivery
Laurie Sharp, Coordinator
Drinking Water & Wastewater Operator Certification and Drinking Water Capacity Development
Iowa Department of Natural Resources
Bureau of Water Quality
![Page 18: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/18.jpg)
Pre Covid Exam Delivery in Iowa:
◼ Six Regional IDNR Field Offices
◼ Proctored by regional office front desk staff
◼ Computer based with automatic scoring and diagnostics upon completion
◼ Community College Computer Lab:
◼ Walk in hours six days a week; open late on T and Th
◼ Proctored by computer lab staff; ABC trained
◼ Computer based with automatic scoring and diagnostics upon completion
![Page 19: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/19.jpg)
In a Pickle…
◼ Venues closed indefinitely: March
◼ Ambiguity as to when, if, and at what capacity venues would reopen…
◼ Regress back to paper exams?
![Page 20: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/20.jpg)
Remote Proctoring as a solution?
◼ Iowa’s training infrastructure had made almost an immediate switch to virtual
◼ Iowa’s educational system, secondary and post high school, had made the leap to online instruction and virtual, secure testing.
![Page 21: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/21.jpg)
Association of Boards of Certificationto the rescue..
◼ Iowa was already contracting with ABC for the electronic delivery of ABC National Standardized exams.
◼ ABC’s relationship with a company who had been providing this service globally for years: PSI
![Page 22: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/22.jpg)
Remote Proctoring:
◼ A testing candidate can take an exam from anywhere 24/7 as long as they have the following:
◼ Laptop or Computer with camera and microphone
◼ Quiet, secluded spot
![Page 23: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/23.jpg)
Remote Session Security:
◼ Live proctor check in: ID check
◼ Proctor to Examinee Ratio: 1:8
◼ Scan of surroundings
◼ Session recorded
◼ Calculator & Formulas on screen
![Page 24: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/24.jpg)
Iowa Exam Process :
◼ Apply Online or Paper Application:
◼ FY20- 88% were online submittals
◼ Eligibility Letter issued by State
◼ Operator contacts us to let us know if they want to take exam remotely or at a specific venue
◼ In a few months they will be able to indicate their choice online during application submittal.
![Page 25: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/25.jpg)
Exam Process in Iowa:
◼ Iowa Venue Electronic Delivery:
◼ Iowa staff emails a spreadsheet with the following info to ABC:
◼ Operator Name
◼ ID#
◼ Phone/ contact number
◼ Exam Category, Type and Grade
◼ (i.e. Drinking Water Treatment Grade 3)
◼ ABC sets up electronic exams with secure User IDs and Passwords for Iowa Proctors
![Page 26: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/26.jpg)
IA Exam Process Continued:
◼ Remote Proctoring Delivery:
◼ Iowa staff enters info into an “Iowa specific” dashboard PSI calls a “Bridge.”
◼ Operator Name
◼ ID#
◼ Email address
◼ Exam Category, Type and Grade
◼ (i.e. Drinking Water Treatment Grade 3)
![Page 27: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/27.jpg)
Remote Proctoring Delivery once PSI has operator information:
◼ PSI emails operator individual link for exam scheduling
◼ Operator has complete control over scheduling and rescheduling
◼ PSI offers 24/7 technical assistance for any IT issues
![Page 28: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/28.jpg)
Downsides to Remote Proctoring?
Higher Price per Exam Package (Debunked):
◼ Scheduling & rescheduling all done by Operator
◼ Exams can be taken 24/7
◼ No travel / per diem
◼ Less time away from system operations
◼ Customer Service & TA provided by testing company- not DNR program staff
![Page 29: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/29.jpg)
Downsides to Remote Proctoring?
◼ Inadequate Internet Infrastructure? (Debunked)
◼ Experience drawn from switch to virtual continuing education
◼ Experience drawn from switch to web based, electronic exams years ago
![Page 30: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/30.jpg)
Thanks to COVID-19
◼ Increase in exam accessibility
◼ Future pandemics (knock on wood) there will be no “interruption” in service
◼ Accelerated the sometimes slow wheels of bureaucracy.
![Page 31: Adaptive Training and Testing Techniques...Donald Papai Apprentice Training Director Alliance of Indiana Rural Water PO Box 789 Franklin, IN 46131 Tel: (317) 789-4200 Email: dpapai@inh2o.org](https://reader035.fdocuments.us/reader035/viewer/2022063023/5feb87917ca6f805dd5379d0/html5/thumbnails/31.jpg)
Questions:
◼ Laurie Sharp ◼ 515/725-0284
◼ Tom Healy, Associations of Boards of Certification◼ 515/963-5921