I Love Natural Language Processing

[Moses-support] Alignment information from binary phrase table

Hello all,

I am trying to get the alignment information from a binary phrase table that was generated from a plain phrase table containing alignment information.

I load the phrase table through the following piece of code:
——————
numScoreComponent=5;
numInputScores=0;
tableLimit=0;
weightWP=0;

input.push_back(0);
output.push_back(0);

weight.push_back(0); weight.push_back(0);
weight.push_back(0); weight.push_back(0); weight.push_back(0);

PhraseDictionaryTreeAdaptor *pd=new
PhraseDictionaryTreeAdaptor(numScoreComponent, numInputScores);

pd->DisableCache();

if (!pd->Load(input, output, “/path/to/phrase/table”, weight, tableLimit, lmList, weightWP)) {
delete pd;
cerr<<"Error: Cannot load Moses binary phrase table, path='"< exit(EXIT_FAILURE);
}
------------------

and I get the following error message:

reading bin ttable
size of OFF_T 8
ERROR:You are asking binary phrase table without word alignments but the
file do not exist. Please check if you had generated the correct phrase
table without word alignment
(phrase-table.binphr.srctree,phrase-table.binphr.tgtdata)

ERROR:bin ttable was read in a wrong way

When the binary phrase table does not contain any alignment information
it works without problems.

How should a binary phrase table with alignment information be loaded?
Should I change some parameters? Which? Any help will be very valuable.

Thank you very much in advance, and happy new year.

Re:[Moses-support] Alignment information from binary phrase table

hi felipe

The decoder no longer read the word alignment information and the binary phrase table no longer carries that information.

there were problems with the implementation which made the decoder really slow and ate memory.

i have a new binary phrase table which does carry the information which you’re welcome to use but you’ll need to integrate it with the existing decoder.

Alternatively, roll back to before the alignment information was taken out

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Related posts:

1. Moses Support Digest:Reading binary phrase table from the disk
2. Moses Support Digest:2.718 in the phrase-table
3. Moses Support Digest: moses_chart and recaser phrase-table
4. Moses Support Digest: Moses seems to hang
5. Moses Support Digest:CreateBerkeleyPt and On-Disk Rule Table
6. Moses Support Digest: EMS table binarization
7. Moses Support Digest: Word Alignment – Moses
8. Moses Support Digest:ConfusionNet GetSubString error when using lattice with UTF8 input
9. Moses Support Digest:POS translation
10. Moses Support Digest:Aligned phrase counts