I Love Natural Language Processing

[Moses-support] Moses Support Digest:A translation chain prototype with Moses + IRSTLM

http://code.google.com/p/moses-for-mere-mortals/

This site offers a set of 3 scripts that, together, create a basic translation chain prototype (with Moses + IRSTLM) able of processing very large corpora. The idea is to help build a translation chain for the real world, but it should also enable a quick evaluation of Moses for actual translation work and guide users in their first steps of using Moses. It is mainly composed of Bash scripts that automate the installation, the training and the translation tasks. It includes documentation on how to use these scripts and provides a demonstration corpus (too small for doing justice to the qualitative results that can be achieved with Moses, but capable of giving a realistic view of the relative duration of the steps involved). For building very large corpora using your own translation memories (*.TMX files), please see http://code.google.com/p/extract-tmx-corpus/.

One would expect that the users of these scripts, perhaps after having tried the demonstration corpus, immediately use and get results with the real corpora they are interested in.

The scripts were tested in Ubuntu 9.04. Some users report problems compiling IRSTLM in Ubuntu 9.10.

Though already tested and used in practical work, this should be considered a work in progress. So as to protect the users not yet completely acquainted with Moses, these scripts try to avoid mistakes that would cost them dearly in terms of time and/or results. That makes them a bit inflexible for the time being, but complete modularity and a flexible, user-friendly approach are very much in the centre of these project’s intentions.

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Related posts:

1. Moses Support Digest: moses-irstlm memory racing with 5-gram lm
2. Moses Support Digest:Translation from English to Foreign Language
3. Moses Support Digest: Word Alignment – Moses
4. Moses Support Digest: Moses release
5. Moses Support Digest:Moses Error in training phrase
6. Moses Support Digest:Call for Participation ACL WMT 2010 Machine Translation Shared Task
7. Moses Support Digest:About giza++ options when running moses
8. Moses Support Digest: Moses seems to hang
9. Moses Support Digest:RDBMS for the decoder
10. Moses Support Digest: Copyright application issue for a Snippet Translation System using MOSES