I Love Natural Language Processing

I LOVE NLP

Archive for the ‘binary phrase table’ tag

Moses Support Digest: processPhraseTable in windows

without comments

[Moses-support] processPhraseTable in windows

Dear All,

I would like to know how to run processPhraseTable in windows to make Binary Phrase Tables.

Best Regards,
Kyaw Kyaw Zin
Read the rest of this entry »

Written by 52nlp

May 24th, 2010 at 11:03 pm

Posted in Moses,SMT

Tagged with , , ,

Moses Support Digest:Alignment information from binary phrase table

without comments

[Moses-support] Alignment information from binary phrase table

Hello all,

I am trying to get the alignment information from a binary phrase table that was generated from a plain phrase table containing alignment information.

I load the phrase table through the following piece of code:
——————
numScoreComponent=5;
numInputScores=0;
tableLimit=0;
weightWP=0;

input.push_back(0);
output.push_back(0);

weight.push_back(0); weight.push_back(0);
weight.push_back(0); weight.push_back(0); weight.push_back(0);

PhraseDictionaryTreeAdaptor *pd=new
PhraseDictionaryTreeAdaptor(numScoreComponent, numInputScores);

pd->DisableCache();

if (!pd->Load(input, output, “/path/to/phrase/table”, weight, tableLimit, lmList, weightWP)) {
delete pd;
cerr< <"Error: Cannot load Moses binary phrase table, path='"< exit(EXIT_FAILURE);
}
------------------

and I get the following error message:

reading bin ttable
size of OFF_T 8
ERROR:You are asking binary phrase table without word alignments but the
file do not exist. Please check if you had generated the correct phrase
table without word alignment
(phrase-table.binphr.srctree,phrase-table.binphr.tgtdata)

ERROR:bin ttable was read in a wrong way

When the binary phrase table does not contain any alignment information
it works without problems.

How should a binary phrase table with alignment information be loaded?
Should I change some parameters? Which? Any help will be very valuable.

Thank you very much in advance, and happy new year.
Read the rest of this entry »

Moses Support Digest:Reading binary phrase table from the disk

without comments

[Moses-support] Reading binary phrase table from the disk

Hello,

As I understand, when given a binary phrase table, moses does not load it into memory, but rather seeks for phrases in file directly from disk. Could you please tell me, what are the functions in C++ that are used for this purpose.

Thank you,

Michael.
Read the rest of this entry »

Written by 52nlp

January 5th, 2010 at 8:56 pm

Posted in Moses,SMT

Tagged with , , ,