Automated Formative Assessment: Providing Linguistic Support through Online Modules
description
Transcript of Automated Formative Assessment: Providing Linguistic Support through Online Modules
![Page 1: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/1.jpg)
1
Automated Formative Assessment: Providing Linguistic Support through Online Modules
Presented by: Ken Petersen
11/18/2011
ASEES 42nd Annual ConventionWashington, DC
![Page 2: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/2.jpg)
2
What is Formative Assessment?
Formative assessment allows a teacher to capture learning as it occurs, and to make appropriate instructional adjustments.
It is distinct from summative assessment in several aspects:
o Frequencyo Goals
Stakes Stakeholders
o Outcomes What effect does assessment have on the learner’s linguistic development
and/or language career path?
o Shelf-life of the data
![Page 3: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/3.jpg)
3
Online Formative Assessment
• The state of the art for the critical languages is less than optimal.
o First generation Web-based CALL applications provide little data on learner performance and live in strict isolation from one another.
Russnet, Langnet, GLOSS, Arabic Without Walls, CenAsiaNet, etc.
o Development of good materials is time and labor intensive.
• Russnet has been providing learners and teachers the opportunity to use online pedagogical materials for formative assessment for over a decade.
o Reading, listening and writing activities that capture: Scores Student mistakes Student essays Teacher feedback
o Data collected to date: Activities completed: 321,368 Mistakes: 566,077 Student Essays: 26,302 Writing Comments: 2,735
![Page 4: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/4.jpg)
4
Moving Forward
• Opportunities for online formative assessment are growing at a staggering rate.
o Access to authentic language content (text, audio and video)o Online communication provides immediacy in feedbacko Natural Language Processing (NLP) tools and resources are moving
online NLP Tools
Part of speech taggers Morphological analyzers Syntactic parsers
NLP resources Electronic dictionaries Bi-text corpora
o Web-services are allowing data and functionality to be shared between applications.
![Page 5: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/5.jpg)
5
Generating Dynamic Activities
Together with the Center for Research in Computational Linguistics, American Councils is developing a suite of online tools for generating “on the fly” support for Russian lexis and morphology.
The technology can embed instructional support into Russian texts from a broad array of contexts.
The learner performance data derived from these activities could be used to provide pedagogically meaningful feedback to learners and teachers.
An initial prototype is the Russian News Reader.
![Page 6: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/6.jpg)
6
Russian News Reader (RNR): Search
![Page 7: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/7.jpg)
7
RNR: Search Result
![Page 8: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/8.jpg)
8
RNR: Lexical Support
![Page 9: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/9.jpg)
9
RNR: Passive Morphological Support
Highlight: Verbs
![Page 10: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/10.jpg)
10
RNR: Passive Morphological Support
Fill-in the Blanks: Adjectives
![Page 11: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/11.jpg)
11
RNR: Passive Morphological Support
Multiple-choice: Adjectives
![Page 12: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/12.jpg)
12
Dynamic Activities & Formative Assessment
• The challenge at hand is to effectively model the data that we might capture from learner-text interactions.
• We have robust knowledge of lexis and morphology:o Part of speecho Gendero Numbero Case
• We need to create a model that will provide informative and actionable evidence for formative assessment.
• There need to be intuitive graphical representations of the data.
• Khan Academy provides a nice framework for this.
![Page 13: Automated Formative Assessment: Providing Linguistic Support through Online Modules](https://reader036.fdocuments.us/reader036/viewer/2022062422/56813e3a550346895da81e53/html5/thumbnails/13.jpg)
13
Contact
Ken PetersenAmerican Councils for International Education1828 L Street NW, Suite 1200Washington, [email protected]
You can download this presentation at: http://lab.americancouncils.org/pres/AFA.ppt