Stanford Language Center Elizabeth Bernhardt, Joan Molitoris, Alice Miano, Sara Gelmetti, Kenric...
-
Upload
nevaeh-berner -
Category
Documents
-
view
220 -
download
2
Transcript of Stanford Language Center Elizabeth Bernhardt, Joan Molitoris, Alice Miano, Sara Gelmetti, Kenric...
Stanford Language CenterElizabeth Bernhardt, Joan Molitoris, Alice Miano,
Sara Gelmetti, Kenric Tsethlikai, Ken Romeo
Stanford University Language Center
Objectives
• Outline assessment program• Provide organizational details• Highlight speaking & writing• Relevant across all languages• Refer to both first & second-year
Stanford University Language Center
The ‘Why’
• Improve student performance• Enhance credibility (w/ public)• Programmatic consistency
Stanford University Language Center
Results
• More highly trained staff• Professional conversation• 20% first-year/24% second-year increase• Highly positive student reaction• Increased interest in proficiency
notation
Stanford University Language Center
Organization
• Placement testing (Bernhardt)• Oral assessments
– SOPIs (Molitoris)– Presentational speech (Miano)– ODAs (Gelmetti)
• Writing assessments– WDAs (Gelmetti)– Presentational Writing (Tsethlikai)
Stanford University Language Center
Placement Testing
• Approaching Stanford
• Online during the summer
• Preliminary placement based on score
• Oral assessment on campus
Stanford University Language CenterPlacement Testing – Elizabeth Bernhardt
SOPI definitionSHORT FORM
20 minutes
Warm-upPicture-based tasks
TopicsWind-down
Task levels: Intermediate, Advanced
LONG FORM45 minutes
Warm-upPicture-based tasks
TopicsSituations
Wind-down
Task levels: Intermediate, Advanced, Superior
Stanford University Language CenterSOPIs – Joan Molitoris
Stanford Uses of SOPIs
• Placement Testing• 3rd Quarter Exit Testing• Overseas Studies Testing• Occasional/External Testing• Proficiency Notation Guidance
Stanford University Language CenterSOPIs – Joan Molitoris
SOPI Development
• Objective: develop multiple prompts leading to unique tests
• SOPI “Task Force”: task and prompt creation
• Logistics: artwork, test booklet, recording of instructions and prompts
• Load into course management system
Stanford University Language CenterSOPIs – Joan Molitoris
SOPI Delivery
• Digital Language Lab scheduling
• Upload/download• Variable class purpose• Results assessed over
the summer by internal OPI testers
• Results published in Annual Report
Stanford University Language CenterSOPIs – Joan Molitoris
Future Directions
• Develop SOPIs for languages with increasing enrollments
• Compile unique tests for specific purposes
• Create “item bank” to allow for randomized delivery of questions within test format
Stanford University Language CenterSOPIs – Joan Molitoris
Oral Presentational Language
• Stanford Objectives for Spanish and Portuguese (1997) based on National Standards
• Tri-modal nature of communication• Emphasis on interpersonal
communication in first-year courses• Emphasis on presentational
communication in second-year courses
Stanford University Language CenterPresentational Speech – Alice Miano
Emphases in Communicative Modes through the two-year program
Stanford University Language CenterPresentational Speech – Alice Miano
First Year | Second Year Second Year
Modes of Communication Presentational Mode
Interpersonal
Interpretive
Presentational
Use of notes
Length
Sophistication / Extemporaneousness
How to evaluate oral presentational language?
• Organization/Structure• Critical Thinking: Content Analysis and Use
of Evidence• Fluency: Length, Level of Rehearsal or
Reading vs. Spontaneity/Extemporaneousness
• Vocabulary: Use of Academic, Presentational Language
• Accuracy
Stanford University Language CenterPresentational Speech – Alice Miano
Without Assessment Tool
• Assessments varied widely amongst instructors
• Student performances tended to fall below expectations
Stanford University Language CenterPresentational Speech – Alice Miano
Initial Findings Using Assessment Tool
• Students and instructors more cognizant of expectations
• Student performances improved and objectives more frequently met
• Greatly increased inter-rater reliability• Instructors excited and motivated to
continue the project, collaborate further
Stanford University Language CenterPresentational Speech – Alice Miano
OnDAsOnline Diagnostic Assignments
• Computer-assisted diagnostic assignments
• Based upon the ACTFL proficiency guidelines
• 2 types: Oral (ODA) and Written (WDA)
• Oral (ODAs): 4 times / quarter, 1st and 2nd year
• Written (WDAs): pilot project
• Communication mode: Interpersonal
• Limited-time assignments
Stanford University Language CenterOnDAs – Sara Gelmetti
Structure of the OnDAs
• Prompts are tailored according to the proficiency level that is being assessed
• First part: warm-up and level check• Second part: probes more challenging
functions spirals up the assignment• Last part: “wind-down” question
returns the student to a comfort level
Stanford University Language CenterOnDAs – Sara Gelmetti
Example 1: LA STANZA DELLO STUDENTEODA ITALIAN 1 - 1st YEAR, 1st quarter• Prompt: audio
• Visual input: static
• TARGET: Novice Mid > High
• FUNCTIONS: communicate minimally with lists and formulaic utterances
• CONTEXT / CONTENT: common informal setting / autobiographical information, personal experience
• TEXT TYPE: individual words and phrases, some discrete sentences in the present
Stanford University Language CenterOnDAs – Sara Gelmetti
Example 2: FLORENCE HOSTING FAMILYWDA ITALIAN 2 - 1st year, 2nd quarter• Prompt: written
• TARGET: Novice High > Intermediate Low
• TASKS: simple description on a familiar topic, requests for information, formulate basic questions
• FUNCTIONS: communicate simple facts and ideas; begin to create with the language
• CONTEXT / CONTENT: common informal setting / autobiographical information, personal experience
• TEXT TYPE: discrete sentences in the present
Stanford University Language CenterOnDAs – Sara Gelmetti
Example 3: DAL DOTTOREODA ITALIAN 3 - 1st year, 3rd quarter• Prompt: audio
• Visual input: static
• TARGET: Intermediate Low > Mid
• FUNCTIONS: create with the language, initiate & maintain a simple conversation, ask and answer simple questions, begin to narrate in the past
• CONTEXT / CONTENT: informal settings / familiar topics related to daily and/or personal activities
• TEXT TYPE: discrete sentences
Stanford University Language CenterOnDAs – Sara Gelmetti
Example 4: WINTER HOLIDAY CELEBRATIONWDA ITALIAN 21 – 2nd year, 1st quarter
• Prompt: written
• TARGET: Intermediate Mid > High
• TASK: paragraph length narration of factual nature using appropriate time frame
• FUNCTIONS: uncomplicated communication, description with elaboration, narration in the past
• CONTEXT / CONTENT: informal settings / topics of general and personal interest
• TEXT TYPE: paragraphs with some connectors
Stanford University Language CenterODnAs – Sara Gelmetti
How to Evaluate OnDAs
• on a credit/no credit basis
• individual feedback after every OnDA
• rated according to how the task is performed or, instead, how severely the communication is impeded
• assessment criteria: a series of questions, based upon the ACTFL guidelines for speaking and writing
Stanford University Language CenterOnDAs – Sara Gelmetti
Preliminary findings
• OnDAs can be taken at home individually Class time can be maximized and optimized for useful
practice
Pressure is reduced and affective filter is lowered
• Both students and instructors need to be familiar and comfortable on how to use new technologies
Stanford University Language CenterOnDAs – Sara Gelmetti
Presentational Writing in Second-Year Programs
• Entrance Level of Students
• Preparation for major/minor, WIM courses, courses in other academic disciplines
• Exit Objectives– Written communication for increasingly formal
settings
– Make Connections to areas of academic interest
Stanford University Language CenterPresentational Writing – Kenric Tsethlikai
Targets for Presentational Writing
• Level
• Models
• Characteristics
Stanford University Language CenterPresentational Writing – Kenric Tsethlikai
Interpretive to PresentationalTargets for Interpretive Skills in Second-Year Language Instruction
Practice and gain greater control over interpretive tasks of previous quarter 1st Quarter 2nd Quarter 3rd Quarter
+ Summarize the main and supporting ideas in expository prose, such as: informal correspondence, literary excerpts, short stories, book and film reviews, newspaper and magazine articles and editorials
+ Synthesize ideas in formal correspondence, essays and critical articles; develop a more complete understanding, beyond main ideas
+ Analyze ideas in essays and critical articles, short stories and novels, in addition to texts similar to the previous quarter + Justify personal interpretations of texts by citing textual evidence
▼Targets for Presentational Writing in Second-Year Language Instruction
Practice and gain greater control over advanced-level presentational writing tasks + Write expository prose with good control of high frequency structures and appropriate vocabulary in critical summaries, descriptions and narrations (3-5 page essays)
+ Demonstrate increasing control of advanced-level writing with increasing accuracy and breadth in descriptions, narrations and syntheses of readings (5-6 page essays)
+ Write on a researched topic (with cited sources) that demonstrates strong control of high frequency structures with clear evidence of tone, register and stance (8-10 page essay)
+ Express personal reactions to literary excerpts, short stories, book and film reviews, newspaper and magazine articles and editorials, by citing and describing main and supporting ideas in texts
+ Demonstrate critical thinking and analysis in argumentative /persuasive essay with clear structure (e.g. thesis/anti-thesis/synthesis/hypothesis)
+ Demonstrate critical thinking and analysis with use of cohesive devices and greater lexical sophistication in literary analyses as well as abstract topics such as globalization, immigration and community service
+ State position and opinions + Support opinions and positions through citations and examplesDevelop tone and stance in appropriate register
+ Support opinions through hypothetical outcomes about abstract issues
+ Actively incorporate new structures and appropriate vocabulary
+ Use more accurate and structures and idiomatic expressions
+ Use more specialized vocabulary and idiomatic expressions
+ Continue writing functional-based messages for likely situations in a study abroad program
+ Engage in correspondence for formal contexts (i.e. requesting information about an internship in a francophone country)
+ Continue writing formal correspondence for requests and inquiries
Stanford University Language CenterPresentational Writing – Kenric Tsethlikai
Learning Goals: Writing-as-Process
• Cultivate attention to register, style and cohesion
• Develop socio-cultural awareness and appropriateness
• Highlight conventions for appropriate citations and bibliography
• Prepare Students for Academic and Professional Writing Needs
Stanford University Language CenterPresentational Writing – Kenric Tsethlikai
Future Directions
• Assessment Rubric for Presentational Writing
Stanford University Language CenterPresentational Writing – Kenric Tsethlikai
Thank You!
• Philosophy• An invitation
– Please email us
– Please visit us
• Open for questions
Stanford University Language Center