Moses Support Digest:The results of your email commands

52nlp — Wed, 23 Dec 2009 15:56:27 +0000

[Moses-support] The results of your email commands

Hi,
I would really appreciate it if you could help me with the following question I have:
I was wondering if a LM created with RANDLM can be converted into a binary format?

Or is there maybe another way of loading the model faster?

I know it is possible with IRSTLM and SRILM but I couldn’t find anything about RANDLM.
Thank you in advance for your support

Best regards,
Arda Tezcan

Re:[Moses-support] The results of your email commands

randlm is already in a binary format, so there is no extra conversion loading randomised models faster is not something that we have really looked at.

Miles

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Moses Support Digest:moses threads compilation problem with RandLM

52nlp — Thu, 17 Dec 2009 14:31:33 +0000

[Moses-support] moses threads compilation problem (with RandLM)

Hi Barry and other folks,

I’m also having trouble compiling Moses with threads and RandLM, there seems to be a bug in MainMT.cpp ?

Here is what I am doing:

Get fresh copy of Moses (I did this on Monday night).

./regenerate-makefiles.sh
./configure –enable-threads
–with-srilm=/home/users6/fraser/statmt/srilm-1.5.7
–with-randlm=/home/users6/fraser/statmt/randlm-v0.11
–with-boost=/home/users6/fraser –with-boost-thread=boost_thread
make

(The last argument –with-boost-thread is necessary to stop it from picking up the globally installed boost thread library).

I attach config.log, which makes it through fine (though I think there is some weird use of -DWITH_THREADS in there which might be interesting).

I also attach make.log (which only contains the compilation error, I typed make twice).

Let me know if I can provide any more info.

Thanks a lot for your help!

Cheers, Alex
————– next part ————–
A non-text attachment was scrubbed…
Name: config.log
Type: application/octet-stream
Size: 17359 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20091216/b1812336/config-0001.obj
————– next part ————–
A non-text attachment was scrubbed…
Name: make.log
Type: application/octet-stream
Size: 5391 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20091216/b1812336/make-0001.obj

Re:[Moses-support] moses threads compilation problem (with RandLM)

Hi Alex,

unfortunately the randomized language model implementation is not yet thread-safe, so it is incompatible with the multi-threaded Moses. Only the SRILM interface is currently supported.

-phi

Re:[Moses-support] moses threads compilation problem (with RandLM)

Hi Alex

Philipp is correct, multi-threaded moses is unlikely to work with randlm since the latter uses a (presumably) non-thread-safe cache.

As regards the compile error, this is due to a recent change in the mbr code, and the fact that we don’t have a regression test to pick it up. I should be able to fix the compile error fairly quickly, but at the moment I’m not sure what to do about the regression test. Ideally I’d like to get rid of the separate main for mosesmt, although we’d still have to have compiler switches which would leave us open to these issues.

If you roll back to 2636 then mosesmt should compile fine.

You mentioned some “weird use of -DWITH_THREADS” – do you mean the failure of (eg) the test of Ngram.h ? I think this is due to a different problem with configure.ac, which would explain why I keep seeing errors like “WARNING: Ngram.h: accepted by the compiler, rejected by the preprocessor!” !

cheers
Barry

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

52nlp's Learning Notes » RandLM

Moses Support Digest:The results of your email commands

Moses Support Digest:moses threads compilation problem with RandLM