TAUS MT SHOWCASE, Program Overview, Rahzeb Choudhury, TAUS, 10 October 2013
TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012
-
Upload
taus-enabling-better-translation -
Category
Technology
-
view
1.185 -
download
0
description
Transcript of TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set A set of tools based on Adobe technology to simplify your usage of Moses Yu Gong | Software Engineer
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Agenda
§ Addressing Moses Pain Points
§ Advantages of Moses Tool Set
§ Moses Tool Set Architecture
§ Moses Tool Set Features
§ Useful Resources
§ Q&A
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Addressing Moses Pain Points
1. Corpus Cleaning
2. Engine Training
3. Engine Testing
4. Integrating Moses With Linguistic Platform
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Advantages of Moses Tool Set
• User Friendly
• Platform Independent
• Open Source
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Architecture
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features – Corpus Cleaning
Moses Func*onality • Tokenizing • Casing • Long Segments
Adobe Func*onality • Placeholder Handling • URL Handling • Number Cleaning • Duplicate Line
Cleaning • Weird Aligned Pairs • Cleaning by regular
expressions
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features – Corpus Splitting & Uploading
Split Corpus by Purpose • Training • Tuning • TesCng
Upload Split Corpus to Moses Server
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Training & Tuning
Command Line Pain
Human Unfriendly • Highly Detailed • Error Prone • Difficult To Reproduce
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Training & Tuning
UI To Simplify Inputs • Training Run ID • Language Model
Parameters • Corpus ID • Source & Target • Default Alignment • Default Reordering • Remote Server
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Testing
• How do you know when an engine is good enough? • How do you know when it is intrinsically flawed? • How do you automate comparing a new engine to old ones?
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Testing
• Reliable Scoring • Bleu/Nist/Meteor
• Simplified UI • Dynamic ConnecCon to
exisCng engines • Repeatable
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Testing
• Reliable Scoring • Bleu/Nist/Meteor
• Simplified UI • Dynamic ConnecCon to
exisCng engines • Repeatable
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Automation
Corpus Cleaning
Corpus Splitting & Uploading
Training & Tuning
Testing
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Localization Workflow Integration
Moses Tooling Chain
Linguistic Platform
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Resources
Source Code: http://code.google.com/p/m4loc
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Questions
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.