I Love Natural Language Processing

I LOVE NLP

Archive for the ‘phrase-table’ tag

Moses Support Digest: EMS table binarization

without comments

[Moses-support] EMS: table binarization

Hi all,

I’m trying to run a system with a binary phrase table, and it doesn’t appear to be doing the binarization. Looking in experiment.meta the relevant section appears to be

binarize-config
in: config
out: bin-config
pass-unless: binarize-all
rerun-on-change: config
default-name: model/moses.bin.ini
template: $binarize-all $ttable-binarizer $rtable-binarizer OUT IN

I can specify ttable-binarizer and rtable-binarizer, but I can’t work out what the value of binarize-all should be. Any suggestions?

Thanks,
Suzy
Read the rest of this entry »

Written by 52nlp

May 30th, 2010 at 11:21 pm

Posted in Moses,SMT

Tagged with , , , , ,

Moses Support Digest:2.718 in the phrase-table

without comments

[Moses-support] 2.718 in the phrase-table

The exact purpose of the value 2.718 is what I am not sure of.As far as I know, the value is used for preferring the hypothesis with less phrases tothe one that use more phrases(words) for the same coverage of the source sentence duringthe prefix cost comparison inside priority queue( for the hyps that covers the same source range ).for example ) phrase_1 + phrase_2 + phrase_3 )to prefer hyp1 to hyp2 by multiplying hyp1 by 2.718.This is how I understand the use of the value, since longer phrase has empirically better translationthan the one made up of word-based translation.Is there any one who can confirm my belief, or to correct my conclusion?p.s. Is 2.718 the Euler’s number? If it is, why is the weight determined as such?
Read the rest of this entry »

Written by 52nlp

February 23rd, 2010 at 7:54 pm

Posted in Moses,SMT

Tagged with , , ,