Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source...
Transcript of Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source...
![Page 1: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/1.jpg)
![Page 2: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/2.jpg)
![Page 3: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/3.jpg)
![Page 4: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/4.jpg)
Sentence-aligned corpus
cat ||| chat ||| 0.9 the cat ||| le chat ||| 0.8dog ||| chien ||| 0.8 house ||| maison ||| 0.6 my house ||| ma maison ||| 0.9language ||| langue ||| 0.9 …
Phrase table(translation model)Word alignments
![Page 5: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/5.jpg)
![Page 6: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/6.jpg)
efsource phrase
target phrase
translation features
Translation Model
e
Language Model
f e
Reranking Model
feature weights
Parallel corpus
Monolingual corpus
Held-out parallel corpus
![Page 7: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/7.jpg)
![Page 8: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/8.jpg)
![Page 9: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/9.jpg)
![Page 10: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/10.jpg)
![Page 11: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/11.jpg)
![Page 12: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/12.jpg)
![Page 13: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/13.jpg)
![Page 14: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/14.jpg)
![Page 15: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/15.jpg)
![Page 16: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/16.jpg)
![Page 17: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/17.jpg)
![Page 18: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/18.jpg)
![Page 19: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/19.jpg)
![Page 20: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/20.jpg)
![Page 21: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/21.jpg)
![Page 22: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/22.jpg)
![Page 23: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/23.jpg)
![Page 24: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/24.jpg)
![Page 25: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/25.jpg)
![Page 26: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/26.jpg)
![Page 27: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/27.jpg)
![Page 28: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/28.jpg)
![Page 29: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/29.jpg)
![Page 30: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/30.jpg)
![Page 31: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/31.jpg)
![Page 32: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/32.jpg)
![Page 33: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/33.jpg)
![Page 34: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/34.jpg)
![Page 35: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/35.jpg)
![Page 36: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/36.jpg)
▪▪
→
▪→
![Page 37: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/37.jpg)
▪▪▪
▪
![Page 38: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/38.jpg)
▪
![Page 39: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/39.jpg)
▪▪
▪
see simplification trick in the previous lecture
![Page 40: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/40.jpg)
▪▪
▪
▪
Initialize c(e|f) = 0 for all e, f in vocabfor every sentence pair e,f: for every alignment a do for j = 1..len(e) do c(ej|fa(j)) += p(a|e,f)
![Page 41: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/41.jpg)
▪▪
▪
▪
▪
![Page 42: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/42.jpg)
▪▪
▪
▪
▪
E-step
M-step
t-table
![Page 43: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/43.jpg)
t-table
![Page 44: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/44.jpg)
t-table
![Page 45: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/45.jpg)
t-table
![Page 46: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/46.jpg)
t-table
![Page 47: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/47.jpg)
E-step
t-table
![Page 48: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/48.jpg)
E-step
M-step
t-table
![Page 49: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/49.jpg)
p(the|la) = c(the|la)/c(la)
E-step
M-step
t-table
![Page 50: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/50.jpg)
● implementation of IBM Model 1 after applying the simplification trick (in previous lecture)
![Page 51: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/51.jpg)
how many alignment parameters?
![Page 52: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/52.jpg)
▪▪
▪
for each le do: for each lf do: for i = 0..lf do for j = 1..le do align_prob(i|j, le, lf) = 1/(lf+1)
![Page 53: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/53.jpg)
▪▪
▪
for each le do: for each lf do: for i = 0..lf do for j = 1..le do a(i|j, le, lf) = 1/(lf+1)
![Page 54: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/54.jpg)
▪▪
▪
▪
Initialize c(e|f) = 0 for all e, f in vocabfor every sentence pair e,f: for every alignment a do for j = 1..len(e) do c(ej|fa(j)) += p(a|e,f)
same as in Model 1
![Page 55: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/55.jpg)
▪▪
▪
▪
▪same as in Model 1 for t-table parameters
![Page 56: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/56.jpg)
▪
▪same as in Model 1 for t-table parameters
![Page 57: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/57.jpg)
● implementation of IBM Model 2 after applying the simplification trick (in previous lecture)
![Page 58: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/58.jpg)
A:
Thank you , I shall do so gladly .
1 3 7 6 9
1 2 3 4 5 76 8 9
Model ParametersTransitions: P( A2 = 3)Emissions: P( F1 = Gracias | EA1 = Thank )
Gracias , lo haré de muy buen grado .
8 8 88
E:
F:
![Page 59: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/59.jpg)
![Page 60: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/60.jpg)
A:
Thank you , I shall do so gladly .
1 3 7 6 9
1 2 3 4 5 76 8 9
Model ParametersTransitions: P( A2 = 3 | A1 = 1)Emissions: P( F1 = Gracias | EA1 = Thank )
Gracias , lo haré de muy buen grado .
8 8 88
E:
F:
![Page 61: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/61.jpg)
▪▪
▪▪
▪▪
-2 -1 0 1 2 3
![Page 62: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/62.jpg)
![Page 63: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/63.jpg)
![Page 64: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/64.jpg)
![Page 65: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/65.jpg)
▪▪▪
▪
▪
![Page 66: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/66.jpg)
![Page 67: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/67.jpg)
▪▪
![Page 68: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/68.jpg)
![Page 69: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/69.jpg)
Model AERModel 1 INT 19.5HMM E→F 11.4HMM F→E 10.8HMM AND 7.1HMM INT 4.7GIZA M4 AND 6.9
![Page 70: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/70.jpg)
![Page 71: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/71.jpg)
![Page 72: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/72.jpg)
▪
![Page 73: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/73.jpg)
▪
▪→
▪▪
![Page 74: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/74.jpg)
这 7人 中包括 来自 法国 和 俄罗斯 的 宇航 员 .
Decoder design is important: [Koehn et al. 03]
![Page 75: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/75.jpg)
![Page 76: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/76.jpg)
![Page 77: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/77.jpg)
![Page 78: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/78.jpg)
![Page 79: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/79.jpg)
[Koehn et al, 2003]
Segmentation Translation Distortion
![Page 80: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/80.jpg)
![Page 81: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/81.jpg)
Where do we get these counts?
![Page 82: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/82.jpg)
![Page 83: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/83.jpg)
![Page 84: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/84.jpg)
![Page 85: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/85.jpg)
![Page 86: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/86.jpg)
![Page 87: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/87.jpg)
![Page 88: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/88.jpg)
![Page 89: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/89.jpg)
![Page 90: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/90.jpg)
![Page 91: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/91.jpg)
▪
▪▪▪▪
![Page 92: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/92.jpg)
![Page 93: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/93.jpg)
![Page 94: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/94.jpg)
▪▪▪
![Page 95: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/95.jpg)
![Page 96: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/96.jpg)
les chatsaiment
lepoisson
cats
like
fresh
fish
.
.frais
.
▪
▪▪▪ …
▪
▪
▪
![Page 97: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/97.jpg)
▪▪▪
![Page 98: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/98.jpg)
![Page 99: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/99.jpg)
▪▪▪
▪
▪
![Page 100: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/100.jpg)
▪▪
![Page 101: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/101.jpg)
▪▪▪
![Page 102: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/102.jpg)
▪▪▪▪▪
θ
Mod
el S
core
![Page 103: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/103.jpg)
θ
Mod
el S
core
θ
BLE
U S
core
![Page 104: Apache2 Ubuntu Default Page: It worksdemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711...f e source phrase target phrase translation features Translation Model e Language Model f e](https://reader033.fdocuments.us/reader033/viewer/2022053112/60884626f3c87844cf22b82b/html5/thumbnails/104.jpg)