Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. ·...

Neural Interactive Translation Prediction

Rebecca Knowles and Philipp Koehn

–––

Interactive Translation Prediction

••

•

http://www.casmacat.eu/



The company said it will start interviewing applicants this month ,

The company said it will start job talks this month


The company said it will start interviewing talks this


The company said it will start


The company said it will start job applicants this month ,


The company said it will start job talks this month ,


with staff levels rising from October through December .

Interactive Translation Prediction using Search Graph

planned monthsfor

has for months

monthssincehas

he

it

planned monthsfor

has for months

monthssincehas

he

it

Related Work

•–

•–

…•

–•

–

https://www.matecat.com/


https://lilt.com/

Ein Auftakt in dersouveräner Saison

Neural Machine Translation

Ein Auftakt in dersouveräner Saison

Ein in dersouveräner Auftakt Saison


.

.

.

<BOS>


.

.

.

Distribution Over Vocabulary

0.6 a

0.3 an

0.05 the

0.01 that

... ...

1e-9 halloween

1e-10 trilobite

<BOS>


.

.

.

Attention Mechanism

<BOS>


.

.

.

Condition on Previous Word

<BOS>


.

.

.

Select Most Probable Word

0.6 a

0.3 an

0.05 the

0.01 that

... ...

1e-9 halloween

1e-10 trilobite

<BOS> a


.

.

.

New Distribution, Conditioned on Previous Selection

<BOS> a

.

.

.


.

.

.


Highest probability word:

“sovereign”

<BOS> a

.

.

.


.

.

.


Highest probability word:

“sovereign”

<BOS> a

.

.

.

sovereign


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

prelude

.

.

.

in

.

.

.

the

.

.

.

season

A sovereign prelude in the season


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

prelude

.

.

.

in

.

.

.

the

.

.

.

season


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

prelude

.

.

.

in

.

.

.

the

.

.

.

season

a

✔


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

prelude

.

.

.

in

.

.

.

the

.

.

.

season

a

✔

con-fident

✘


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

start

.

.

.

in

.

.

.

the

.

.

.

season

a

✔

con-fident

✘


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

start

.

.

.

to

.

.

.

the

.

.

.

season

a

✔

con-fident

✘


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

start

.

.

.

to

.

.

.

the

.

.

.

season

a

✔

con-fident

✘

start

✔


.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

start

.

.

.

to

.

.

.

the

.

.

.

season

a

✔

con-fident

✘

start

✔to the season

✔ ✔ ✔

.

.

.

<BOS> a

.

.

.

sovereign

.

.

.

start

.

.

.

to

.

.

.

the

.

.

.

season

a

✔

con-fident

✘

start

✔to the season

✔ ✔ ✔

Word Prediction Accuracy

In this example, what fraction of suggestions were accepted?

5/6

Interactive Translation Prediction with Neural MT

•–

Interactive Translation Prediction with Neural MT

•–

•

Evaluations

••••

Evaluation Data

•–––

MT Systems

•–

•–

http://www.statmt.org/wmt16/pdf/W16-2323.pdf




System Quality

System Configuration BLEU

Neural no beam searchbeam size 12+ensemble+r2l reranking

34.536.237.538.6

Phrase-based 34.5


Correct Prediction

✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔

thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.

thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.

Example with about-average word prediction accuracy.

(13/20)


System Configuration Word Prediction Accuracy

Neural no beam searchbeam size 12

61.6%63.6%

Phrase-based - 43.3%

DistributionsCorrect Prediction

✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔



Recovery from First Failure

Recovery from First FailureCorrect Prediction

✔✔✔✗✗✔

andsomeareholdingoutfor...

andsomearewaitingontofor...

Correct Prediction

✔✗✔✔✔

atthistimelastcycle...

atthattimelastcycle...

Sequences of MispredictionsCorrect Prediction

✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔



Deployment and Speed

CASMACAT: http://www.casmacat.eu/

Lilt: https://lilt.com/


https://lilt.com/

Patching Partial Predictions

Patching Partial Predictions

→

Conclusions

•

–––

Thank You

mailto:[email protected]

http://www.cs.jhu.edu/~rknowles/

http://www.cs.jhu.edu/~phi/publications/neural-interactive-translation.pdf

Detailed Recovery

Length of Error Sequences

Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. ·...

Documents

Transcript of Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. ·...