Elicitation Procedures

19
Elicitation Procedures Pribadi Hadhi

description

Elicitation Procedures for Language Research

Transcript of Elicitation Procedures

Page 1: Elicitation Procedures

Elicitation Procedures

Pribadi Hadhi

Page 2: Elicitation Procedures

Today’s Topic

A Sample Study Payoffs and PitfallsProduction Tasks

Page 3: Elicitation Procedures

Production Tasks

Production tasks are techniques used to obtain samples of learner language, typically in order to study process and stages of development that learners pass through as they develop their second language proficiency.

Discourse

Completion

Tasks

Role Plays

Tests Used as Elicitati

on Proced

ures

Picture Descrip

tion Tasks

Using Tasks

to Investig

ate Negotiation of Meanin

g

Page 4: Elicitation Procedures

Discourse Completion Tasks

In this situation, the researcher sets up a context and provides part of the discourse. The learner must then complete the interaction by expressing what he or she would say if he or she were actually in such a context.

You discover your library book must be returned today and you will have to pay a fine if you don’t return it immediately. You say to your friend, “May I please borrow your bicycle to go to the library?”.

Your friend says, “No, I need it myself”.You say, “_______________________________________________”

Page 5: Elicitation Procedures

Role PlaysIn this situation, the researcher uses scenarios to elicit language learners’ speech samples and ideas.

1) The researchers asked respondent to imagine themselves at a parking meter with no change, having to borrow some coins from an older stranger as the meter maid draws closer and closer.

2) The researchers asked the respondents to put themselves in a situatin where they were late to a lunch appointment with an older business acquintance whom they do not know well.

Role plays have been used in language assessment as well as in data collection, but some researchers have voiced concerns about whether personality or acting ability may influence the outcome.

Page 6: Elicitation Procedures

Test used as Elicitation Procedures

All tests consist of four components:1. The stimulus material (an essay prompt, a listening passage,

a reading text, etc.);2. The task posed to the learner (the mental operations the

learner must do);3. The learner’s response;4. The scoring criteria (objective or subjective)

Dictations

Close Passag

es

Multiple-

choice Items

Matching

Items

Essays, etc.

Page 7: Elicitation Procedures

Test used as Elicitation Procedures

Oral proficiency interviews used to elicit speech samples from learners. It’s not thelearners’ ideas per se that interest the researchers. Rather, it is the language usedto express those ideas. ILR (Inter-agency Language Roundtable) ACTFL (American Council of Teachers of Foreign Languages)

Standardized language tests, particularly of English proficiency. IELTS TOEFL TOEIC SLEP (Secondary Level English Proficiency)

Page 8: Elicitation Procedures

The idea that a test must be consistent across administrations

The effect of a test on teaching and learning.

A matter of whether a test is actually assessing what it was designed to measure

The question of how many resources are used in developing, administering, and scoring a test in order to get the needed

information

Reliability

Washback

Practicality

Validity

Traditional Criteria for Evaluating Test

Page 9: Elicitation Procedures

The degree of correspondence of the characteristics of a given language test task to the features of a target language use task.

The extent and type of involvement of the test taker’s individual characteristics in accomplishing the task.

Authenticity

Interactiveness

Traditional Criteria for Evaluating Test

Page 10: Elicitation Procedures

Picture Description Tasks

One common way of stimulating production was to ask the informant questions about a series of pictures. The morpheme order studies used as a test known as the Bilingual Syntax Measure (BSM). It consists of a series of simple, colorful, cartoon like drawings. The informant was shown the pictures one at one time and asked questions meant to elicit the target language items being investigated.

Page 11: Elicitation Procedures

Picture Description Tasks

Page 12: Elicitation Procedures

Using Tasks to Investigate Negotiation of Meaning

A considerably body of research has used production tasks to investigate interactional modifications, otherwise known as the negotiation of meaning. Such modification include comprehension checks, clarification requests, incorporations, and so on.The relationship between interactional modifications and negotiation of meaning:Linguistic conversational adjustment…….promote comprehensible input because such adjustments are usually triggered by an indication of non-comprehension, requiring the speaker to reformulate his or her utterance to make it more comprehensible. IF comprehensible input promotes acquisition, then it follows that linguistic/conversational adjustment promote acquisition. (Nunan, 2004: 80)

Page 13: Elicitation Procedures

A Study from Martyn (1996; 2001)

Martyn used five production tasks:(1) jigsaw, (2) information exchange, (3) problem solving, (4) decisionMaking, and (5) opinion exchange.

She also isolated the following four cognitive demand features of tasks:1. Contextual support: whether embedded, reduce, or remote within

the task2. Reasoning demand: whether high or low3. Degree of task structure: whether high or low4. Availability of knowledge schema: provided or assumed through prior

knowledge.

Page 14: Elicitation Procedures

A Study from Martyn (1996; 2001)

Task Type Contextual Support

Reasoning Required

Degree of Task Structure

Available Knowledge

Jigsaw Embedded Not required High Given

Information Exchange Embedded Not required High Given

Problem Solving Some embedded Required Varies Given

Decision Making Context-reduced Required Low Given or available

Opinion Exchange Remote Required Low Variable/not

required

Tasks with the highest cognitive demands, such as the opinion exchange task, generated the most interactional modifications, while jigsaw tasks, with relatively low cognitive demand, generated the fewest modification

Page 15: Elicitation Procedures

A Sample Study

Page 16: Elicitation Procedures

What instructional practices do

language minority

students view as effective?

What is the role that they

see themselves

playing in the transmission

of school value?

How can the school

environment help language

minority students to

socialize into the new school

culture?

In what ways can language

minority students help

their peers become

successful in the new school

system?

A Sample Study: Research Questions

Page 17: Elicitation Procedures

The first interview (in English) was a card sort activity.

The second interview (in Spanish) was a problem –solving task involving a role play.

The students’ preferences in the card sort activity were analyzed quantitatively using chi-square analysis.

The students’ views about speaking English in class were varied.

The students’ views about what constitutes an ideal class were also diverse.

A Sample Study

Page 18: Elicitation Procedures

Payoffs Pitfalls

Because the technique are so diverse, they can result in data that are incredibly rich.

By determining in advance what is going to be considered relevant, other potentially relevant phenomena might be overlooked

Elicitation can be a great time-saver, providing the researchers with large amounts of data in a much shorter time.

When evaluating research utilizing such (elicitation) devices, the extent to which the results obtained are an artifact of the elicitation devices employed.

Elicitation enables the researchers to collect data that could simply not be observed in any other way.

Page 19: Elicitation Procedures

Thank You