I Love Natural Language Processing

I LOVE NLP

Archive for the ‘language model’ tag

Moses Support Digest:Tuning failure with Language model type unknown

without comments

[Moses-support] Tuning failure with “Language model type unknown.”

Hello,
I am currently trying to train a Moses system, which goes fine until the tuning step. I get the following error :

Creating lexical reordering…
weights: 0.111111 0.111111 0.111111 0.111111 0.111111 0.111111
binary file loaded, default OFF_T: -1
Created lexical orientation reordering
ERROR:Language model type unknown. Probably not compiled
into library
ERROR:no LM created. We probably don’t have it compiled
Exit code: 1
The decoder died. CONFIG WAS -w 0.000000 -lm 0.111111 -d
0.111111 0.111111 0.111111 0.111111 0.111111 0.111111 0.111111 -tm
0.033333 0.022222 0.033333 0.022222 0.000000

I have checked the archives of the mailing list, and couldn’t find anything to resolve the problem.
The language model line in the run1.moses.ini is the following
# language models: type(srilm/irstlm), factors, order, file
[lmodel-file]
1 0 5 /home/s0678231/disk1/mt-system/lm/europarl.binlm.1

Is anyone able to help with this ?

Thanks in advance,
Ronan
Read the rest of this entry »

Written by 52nlp

December 28th, 2009 at 8:41 pm

Posted in Moses,SMT

Tagged with , , ,

Moses Support Digest:Building POS language model with SRILM

without comments

[Moses-support] Building POS language model with SRILM
Hi,
The Moses manual recommends using the following switches when building a language model with SRILM:
  -interpolate -kndiscount
I assume this recommendation applies specifically to surface-string language models. For a part-of-speech language model, KN-discounting is inappropriate because it is based on counts-of-counts, and the counts-of-counts for POSes are odd in that there are very few POSes that occur only once or twice in a given corpus.
Are there particular switches that are recommended for building a POS
language model with SRILM?
Regards,
Ben Gottesman
Read the rest of this entry »

Written by 52nlp

November 25th, 2009 at 8:52 pm

Posted in Moses,SMT

Tagged with , , , , ,