DLIFLC STUDENT PROFILES - UT Liberal Arts · • Correlations of DLAB and outcome data –...
27
DLIFLC STUDENT PROFILES Dr. John Lett, Dean* Research and Analysis Defense Language Institute Foreign Language Center *The views expressed are those of the speaker and do not necessarily represent those of the DLIFLC, the Department of the Army, or the Department of Defense.
Transcript of DLIFLC STUDENT PROFILES - UT Liberal Arts · • Correlations of DLAB and outcome data –...
DLIFLC STUDENT PROFILES
Dr. John Lett, Dean* Research and Analysis
Defense Language Institute Foreign Language Center
*The views expressed are those of the speaker and do not necessarily represent those of the DLIFLC, the Department of the Army, or the Department of Defense.
Outline
• Demographics of DLIFLC students • Selection and assignment to language
study at DLIFLC • Role of motivation and language choice in
achieving advanced language learning outcomes.
Selection for Military Language Training (IET)
Recruiting
ASVAB
DLAB
BASIC TRAINING
DLIFLC
Student Demographics
Age
Gender
Education
Service
Years in Service
Paygrade
Aptitude for Language Learning
DLIFLC Learning Environment
• Intensive, small classes • Six or more hours daily • 26 to 63 weeks • Proficiency-oriented approach • Graduation requirement:
L2, R2, S1+ on ILR Scale*
*http://govtilr.org
Description of DLAB • Multiple choice, ~90 minutes • Range 12-164, mean 100, SD 15 (~92, SD
~21 for 143K cases; current DLI means ~112-114)
• Four parts – Bio data – Spoken stress – Deductive rule application – Inductive pattern application
RESEARCH BASE
• Carroll’s four components – phonetic coding ability – grammatical sensitivity – rote learning ability – inductive language learning ability
• Other FL aptitude tests – MLAT (Carroll-Sapon) – PLAB (Pimsleur)
How well does it work?
Very well, thank you – Language Skill Change Project, mid-1980s
– Army Research Institute, 2000-2001
– DMDC study, 2007
– DLIFLC program data, early 1980s to present
LSCP* • 1903 US Army students • Korean, Russian, German, Spanish • Eleven blocks of predictor variables • Forced order-of-entry MRA of L, R, S,
course completion • DLAB added variance, especially for
Russian and Korean *Lett, J. A., and O'Mara, F. E., "Predictors of Success in an Intensive Foreign Language Learning
Context: Correlates of Language Learning at the Defense Language Institute Foreign Language Center," pp 222-260 in Parry, T., and Stansfield, C. W., eds., Language Aptitude
Reconsidered, published for CAL/ERIC by Prentice Hall Regents, Englewood Cliffs, NJ, 1990.
ARI Attrition Study
• Tracked 237 beginning students for a year
• From ARI PI’s outbrief:
– As in past, DLAB is best predictor of attrition DLAB 98 or less = 32% attrition DLAB 99 to 116 = 20% attrition DLAB 117 or more = 10% attrition
– Of DLAB scores above 117, 98% had prior language training Prior language training = 17% attrition No prior language training = 35% attrition
DMDC Study, 2007
• Examined AFQT and DLAB as predictors of language learning success at DLIFLC
• Employed three samples, using Markov chain Monte Carlo procedures and Bayesian modeling
• Findings: AFQT < DLAB < Multiple Hurdle
DLIFLC Program Data
• Correlations of DLAB and outcome data – Consistently significant – Restriction of range affects magnitude
• Eight-year data set: Ss meeting the DLAB minimums have… – Lower attrition rates – Greater success rates (2/2/1+)
• Caveat: High aptitude is a predictor—not a guarantor!
Success Rates by DLAB (FY02 example)
Motivation, Choice, and Outcomes
• Does it matter whether you get a language you wanted?
• How important is motivation to ultimate success at DLIFLC?
Who Studies What?
• Constraints – Minimum DLAB requirements (95, 100, 105,
110) – Needs of the Service
• Timing – Pre-arrival – Post-arrival
Upon Arrival in Assigned Language Department
Does It Matter?
• Study 1: FY90 – FY94 graduates in 8 languages
• Study 2: FY01-FY09 graduates in 9 languages
• Six languages in common: – Arabic, Chinese (M), Korean, Farsi, Russian,
Spanish
Methodology • Compare “choice” responses to language
learning outcomes – Three variants of coding choice responses:
• All five options • “5” vs “1-4” • “5-4” vs “1-3”
– Outcome measures: Listening, Reading, Speaking, and Success (2/2/1, 2/2/1+)
– Partial correlation and chi square analysis – Visual inspection
Findings
• Distribution of Responses
• Relationships of Responses to Outcomes
Nine-Year Responses No reply
Comparison of Responses
Relationships with Outcomes
• Earlier Study – Most correlations non-significant or too small to
matter – Most chi squares non-significant – Much variation across languages and skills
• Current Study – More significant chi squares – Much variation across languages and years
• Caveat: What does “choice” item measure?
Another Look at Motivation
• Language Skill Change Project – 1903 students, 4 languages – Multiple Regression, 9 blocks of predictors
• Forced order-of-entry • Attitude-Motivation measures in blocks 6 and 7
• Motivation at start less predictive than motivation during
• Cognitive variables most predictive
The Bottom Line
