52nlp's Learning Notes » SRILM

Moses Support Digest: cannot find -loolm

52nlp — Sat, 10 Apr 2010 15:47:50 +0000

[Moses-support] cannot find -loolm

libtool: link: g++ -g -O2 -o lmbrgrid LatticeMBRGrid.o LatticeMBR.o IOWrapper.o -L/home/sripirakas/SMT/tools/srilm/lib/i686 ../../moses/src/.libs/libmoses.a -L/home/sripirakas/SMT/tools/moses/OnDiskPt/src -lOnDiskPt -loolm -ldstruct -lmisc -lz
/usr/bin/ld: cannot find -loolm
collect2: ld returned 1 exit status
make[2]: *** [moses] Error 1
make[2]: *** Waiting for unfinished jobs….
/usr/bin/ld: cannot find -loolm
collect2: ld returned 1 exit status
make[2]: *** [lmbrgrid] Error 1
make[2]: Leaving directory `/home/sripirakas/SMT/tools/moses/moses-cmd/src’
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/home/sripirakas/SMT/tools/moses’
make: *** [all] Error 2

Re: [Moses-support] cannot find -loolm

First check in /home/sripirakas/SMT/tools/srilm/lib/i686 to see if the
library oolm is compiled successfully.

If your machine’s architecture is x86-64, SRILM actually compiles its
library for x86 instead. You need to explicitly tell SRILM to target x86-64
– I usually just edit the srilm/sbin/machine-type script and change

else if (`uname -m` == x86_64) then
#set MACHINE_TYPE = i686-m64
set MACHINE_TYPE = i686

else if (`uname -m` == x86_64) then
set MACHINE_TYPE = i686-m64
#set MACHINE_TYPE = i686

And then do a clean build.

Liu Chang
National University of Singapore

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Moses Support Digest:SRILM installation problem

52nlp — Mon, 01 Mar 2010 11:08:01 +0000

[Moses-support] SRILM installation problem

Hi All,

I had a problem to install Moses and posted it here but no response is coming out yet. Can any one help me where to post this. I appreciate you guys for any help.

Mulu G.

Hi All,

I was trying to install srilm on Debian linux 5 lenny, MACHINE_TYPE= i686, with gcc version v 4.3.2. I have changed the Makefile according the manuals and without success. So when I try to enter #make World, it produces the following message

/bin/sh: /root/srilm: is a directory
mkdir include lib bin
mkdir: cannot create directory `include’: File exists
mkdir: cannot create directory `lib’: File exists
mkdir: cannot create directory `bin’: File exists
make: [dirs] Error 1 (ignored)
make init
/bin/sh: /root/srilm: is a directory
make[1]: Entering directory `/root/srilm’
for subdir in misc dstruct lm flm lattice utils; do
(cd $subdir/src; make SRILM=/root/srilm [SRILM] MACHINE_TYPE=
OPTION= MAKE_PIC= init) || exit 1;
done
make[2]: Entering directory `/root/srilm/misc/src’
/root/srilm/common/Makefile.common.variables:96:
/root/srilm/common/Makefile.machine.: No such file or directory
make[2]: *** No rule to make target `/root/srilm/common/Makefile.machine.’.
Stop.
make[2]: Leaving directory `/root/srilm/misc/src’
make[1]: *** [init] Error 1
make[1]: Leaving directory `/root/srilm’
make: *** [World] Error 2

Could you please help me in sorting out the problem and how to fix it.

Thank you all,

Mulu G.

Re:[Moses-support] SRILM installation problem

hi mulu

it seems you have an srilm compilation problem rather than a moses problem. from my experience, srilm is easy to compile but you have to read & follow the instruction very carefully. If you dont succeed, I suggest you download SRILM and start again.

you will know when it succeeds when you have these files are created:
liboolm.a
libdstruct.a
libflm.a
liblattice.a
libmisc.a

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Moses Support Digest:Binarized SRILM

52nlp — Thu, 03 Dec 2009 15:16:45 +0000

[Moses-support] Binarized SRILM

Hi,
just a quick question, can Moses use a binary version of the srilm lm? I have built it with the option -write-binary-lm

Thanks
Marco

Re:[Moses-support] Binarized SRILM

no-one’s asked this before but i’ll be interested to find out. If you anything more, let me know

Re:[Moses-support] Binarized SRILM

Hi Hieu,
I’ll check… and I’ll let u know.

In case this the output of moses using a binarized srilm LM:
[total=-40.478] <<-8.000, -74.000, 0.000, -11.209, -4.077, -2.675, -12.833, -0.519, -5.449, -312.951, -66.706, -138.406, -42.936, -83.404, 32.997>>
which is the LM value? Is it the 10th value?

Thanks
Marco

Re:[Moses-support] Binarized SRILM

Hi,

if you generate an n-best list, the types of the different feature functions are more transparent, but it is a safe bet that your example “-312.951″ is the unweighted language model weight.

-phi

Re:[Moses-support] Binarized SRILM

Hi Philipp and Hieu,

i run this test:
I build a moses model using 62k training sentences, then I build 2 LMs using the same data (English side):
1)the normal srilm
2)the binarized srilm

then i translate.

I got the exactly the same target sentences (I used the “diff” command to compare them). and Blue score (I did not optimize to speed up the test)

Now I’m running a new test using 1.1 M sentences… I’ll let u know later.

the small LM value in the previous example I guess it is due to small amount of training data (as in that case I used only 62k).

if u have any comment, please let me know

Thanks a lot
Marco

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Moses Support Digest:Building POS language model with SRILM

52nlp — Wed, 25 Nov 2009 12:52:10 +0000

[Moses-support] Building POS language model with SRILM
Hi,
The Moses manual recommends using the following switches when building a language model with SRILM:
　　-interpolate -kndiscount
I assume this recommendation applies specifically to surface-string language models. For a part-of-speech language model, KN-discounting is inappropriate because it is based on counts-of-counts, and the counts-of-counts for POSes are odd in that there are very few POSes that occur only once or twice in a given corpus.
Are there particular switches that are recommended for building a POS
language model with SRILM?
Regards,
Ben Gottesman

Re: [Moses-support] Building POS language model with SRILM

Hi,
you are correct that for POS LMs the lower order n-gram counts are very different and smoothing is less relevant.
You could train a 7-gram LM with Good Turing smoothing for the lower order n-grams and Kneser-Ney for the higher order n-grams.
I have done this occasionally.

-phi

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.