Team Pandora Dr. Lisa Irby Dr. Jordan Connie LaFave Janelle Sternberg Tammy Swope
Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby...
-
Upload
leona-robinson -
Category
Documents
-
view
214 -
download
0
Transcript of Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby...
![Page 1: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/1.jpg)
Assessment of Web-based Education Tools: Are your Students Learning Through Technology?
Andrea IrbyUndergraduate Academic Programs
North Carolina State University
![Page 2: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/2.jpg)
Background
NC State is a large, public, research
one institution. 19,000 undergraduates; 9,000 grads. Under pressure in late 1990s to grow Possible expansion of Distance Education Virtual Advising Center created 1999
![Page 3: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/3.jpg)
![Page 4: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/4.jpg)
Why Technology? Enables us to transcend many barriers
Physical campusRaceCountry, nationality“Saving Face”
Student development theory – meet them where they are
Enables us to be more effective and efficient especially in times constrained resources
Why Technology?
![Page 5: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/5.jpg)
Types of Information Exchange
Synchronous vs. AsynchronousData - ways of expressing things Information - the arrangement of data into meaningful patternsKnowledge - the application and productive use of informationInformation versus Knowledge
![Page 6: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/6.jpg)
Technology in EducationCan transform key relationshipsPersonalization: Targeting the student vs. the departmentEngaging the student: making applications interactiveStudent Decision Support: Information becomes knowledgeCreate community: cultivate student relationships
Carl Jacobson, 2000
![Page 7: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/7.jpg)
Engaging Students On-Line
Web-sites On-line Course Management SystemsEmail/ListservsOn line Chat or Instant Messenger type toolsBulletin Boards and BlogsSocial Networking sites
“Students will gravitate toward the technology medium that best meets their needs” Karen Thurmond- Univ of Memphis
![Page 8: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/8.jpg)
Focus on Web-sites2nd Generation Web-sites: Information based3rd Generation are interactive, knowledge based
How do we know if/ how many students come to our website?Are they able to find the information they need?Is it clear and meaningful to them?Do the receive our intended information?
![Page 9: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/9.jpg)
How to Know
Log Data Analysis (data mining)
Usability Studies
Accessibility Testing
![Page 10: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/10.jpg)
Log Data Analysis
Data (log) is created each time a person visits a web-page.
Analytic Tools then either pull data from the server that hosts the web-site or read it from html code on each web-page.
![Page 11: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/11.jpg)
Sample tools Google Analytics (reads code)- free
www.google.com/analytics
SAS Web Analytics (pulls from server)www.sas.com/solutions/webanalytics
TopShareWare (pulls from server)www.topshareware.com/LogSuite-download-38225.htm
![Page 12: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/12.jpg)
Easy to Read Reports (in real life )
![Page 13: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/13.jpg)
Information ReceivedVisitors/UsersRepeat Visitors/Cached VisitorsHow long on siteTraffic by time of day and monthWhere enter, exit, or drop out of siteBrowsers, operating systemsWhere they are logging in fromCampaign/Action Tracking
![Page 14: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/14.jpg)
Virtual Advising Center data mining
2000:
72,419 annual visitors 26,795 repeat visitors176 avg. visitors per day
1,021,947 hits to site
2006:
285,053 annual visitors 108,320 repeat visitors780 avg. visitors per day
8,269,215 hits annually
![Page 15: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/15.jpg)
Virtual Advising Center data mining
Monday-Thursday busiest days. Visitors on site for avg. of 2 minutes now about 5.Path in and out; pages turned.IP locations –whose accessing site on campus, off campus, around the world.Heaviest traffic times per day.
![Page 16: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/16.jpg)
How we used this information
Sent surveys out on busiest daysUsed busiest times of day to determine staff coverage for chatUsed IP address/location information to help IT staff on campus place kiosks in high demand locationsTo enhance relationships with local feeder community colleges
![Page 17: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/17.jpg)
Usability Testing
Observed “Focus” Groups for web-sitesReal data versus self reported dataExamines how people use some human-made object Controlled experimentSmall, cross section of users
Trained users or “Hallway” users
![Page 18: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/18.jpg)
Usability Testing
Pre-test questionnaires get input on subject’s familiarity with web-siteActual test involves a series of short, simple tasks the subject is asked to complete Observations are recorded by “tester”Patterns of how subject completes each task are notedEmotional responses key to watch
![Page 19: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/19.jpg)
Set up
Location can be:In a computer lab with multiple teams
In a usability lab
At your own computer desk
![Page 20: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/20.jpg)
Usability Testing
Post tests – record overall impressions of web-site and experience; reflectionVery Informative Web-site on Usability Testing: www.usability.govIf testing uncovers difficulties, redesignTest in small groups and oftenFor virtual advising center, its how we keep students at the forefront of our design
![Page 21: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/21.jpg)
![Page 22: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/22.jpg)
Accessibility
Inclusive web-communities allow people with diverse abilities to be engaged in on-line learningWeb-Content Accessibility Guidelines
http://www.w3.org/TR/1999/WAI-WEBCONTENT-19990505/#def-checkpoint
3 Priorities for Website Accessibility
![Page 23: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/23.jpg)
Accessibility
Series of CheckpointsPriority 1- Must satisfy these checkpoints or one or more groups will find it impossible to get and use the informationPriority 2- Should satisfy these design elementsPriority 3- May satisfy design elementsResults in A, AA, AAA website ratings
![Page 24: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/24.jpg)
Accessibility
Test your site with on-line toolsTest your site with screen readers/JAWsOn-line web resources to help you:
http://atrc.utoronto.ca/ http://ncsu.edu/it/access/development/software/tools.phphttp://www.accessible.org/bobby-approved.html
![Page 25: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/25.jpg)
Evaluating Learning
Web-site must be interactivetests, essays, portfolios, chats, email
Determine what we want students to learn Get student input Variety of ways: focus groups, check lists, rubrics and content analysis Have more than one staff member working on assessment
![Page 26: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/26.jpg)
What we’ve tried and learned
Focus Groups- what we may see as learning, they see as “help”. Over time, they may recognize what they have learned: raises question of timing of assessmentElectronic communication trails are rich with evidence of learning. Students are readmitting, graduating, learning about themselves, picking majors, staying, expanding their academic portfolios.
![Page 27: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/27.jpg)
Evaluating Learning
Need to develop a rubric for evaluating rich content.
George Mason Business School example
Databases/Microsoft Access tool
Technology is a tool – through which students can learn and for helping us with assessment.
![Page 28: Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.](https://reader035.fdocuments.us/reader035/viewer/2022062801/56649e495503460f94b3c7c8/html5/thumbnails/28.jpg)
Discussion? Questions?