MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.
-
Upload
todd-dickerson -
Category
Documents
-
view
215 -
download
0
Transcript of MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.
![Page 1: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/1.jpg)
MACHINE TRANSLATION PAPER 1
Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny WangCS159 Spring 2011
![Page 2: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/2.jpg)
Paper
Intersecting multilingual data for faster and better statistical translations. Association for Computational Linguistics, June 2009.
Yu Chen Martin Kay Andreas Eisele
![Page 3: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/3.jpg)
Introduction
Statistical Machine Translation (SMT):
Spanish(foreign)
Translationmodel
languagemodel
BrokenEnglish
English
model
€
p(e | f )∝ p( f | e)p(e)
translation model language model
![Page 4: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/4.jpg)
Statistical MT Overview
Bilingual data
model
monolingual data
learned parameters
Foreign sentence
Translation
Find the besttranslation given the foreign sentence and the model
Englishsentence
![Page 5: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/5.jpg)
Problems
Noise from word/phrase alignment Efficiency: time and space
![Page 6: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/6.jpg)
Problems
Sie lieben ihre Kinder nichtThey love their children notThey don’t love their children
ihre Kinder nicht => a) their children are not b) their children
Language model =/= They love their children are not
Solution: remove b) from translation model
![Page 7: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/7.jpg)
http://www.translationparty.com/#9144687 http://www.translationparty.com/#9144706 http://www.translationparty.com/#9144869 http://www.translationparty.com/#9144872 http://www.translationparty.com/#9144881
![Page 8: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/8.jpg)
Solution: Triangulation
SOURCE LANGUAGE TARGET LANGUAGE
BRIDGE LANGUAGE
![Page 9: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/9.jpg)
Triangulation
Look at source-target phrase pair (S,T)
S => X, T => X, S => T (keep) S => X, T => Y, S =/> T (drop) S => ?, T => ?, ??? (keep)
![Page 10: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/10.jpg)
Experimental Design
Database: Europarl (1.3 million) Divided by maximal sentence length Spanish => English; bridges: French,
Portuguese, Danish, German, Finnish Models from Moses toolkit Train, develop, test
![Page 11: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/11.jpg)
![Page 12: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/12.jpg)
Results
![Page 13: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/13.jpg)
![Page 14: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/14.jpg)
Phrase Length
"Long phrases suck” (Koehn, 2003)
![Page 15: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/15.jpg)
![Page 16: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/16.jpg)
Further Research
![Page 17: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/17.jpg)
Further Research
German => English
![Page 18: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/18.jpg)
Problems / Conclusion
Throwing away a lot of data (94%) Picking a bridge language (sometimes) Limitations of data set (Arabic?
Chinese?) Overall, great!
![Page 19: MACHINE TRANSLATION PAPER 1 Daniel Montalvo, Chrysanthia Cheung-Lau, Jonny Wang CS159 Spring 2011.](https://reader035.fdocuments.us/reader035/viewer/2022062423/5697bff51a28abf838cbd79f/html5/thumbnails/19.jpg)
Thanks!