Moses Support Digest:moses threads compilation problem with RandLM

[Moses-support] moses threads compilation problem (with RandLM)

Hi Barry and other folks,

I’m also having trouble compiling Moses with threads and RandLM, there seems to be a bug in MainMT.cpp ?

Here is what I am doing:

Get fresh copy of Moses (I did this on Monday night).

./regenerate-makefiles.sh
./configure –enable-threads
–with-srilm=/home/users6/fraser/statmt/srilm-1.5.7
–with-randlm=/home/users6/fraser/statmt/randlm-v0.11
–with-boost=/home/users6/fraser –with-boost-thread=boost_thread
make

(The last argument –with-boost-thread is necessary to stop it from picking up the globally installed boost thread library).

I attach config.log, which makes it through fine (though I think there is some weird use of -DWITH_THREADS in there which might be interesting).

I also attach make.log (which only contains the compilation error, I typed make twice).

Let me know if I can provide any more info.

Thanks a lot for your help!

Cheers, Alex
————– next part ————–
A non-text attachment was scrubbed…
Name: config.log
Type: application/octet-stream
Size: 17359 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20091216/b1812336/config-0001.obj
————– next part ————–
A non-text attachment was scrubbed…
Name: make.log
Type: application/octet-stream
Size: 5391 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20091216/b1812336/make-0001.obj


Re:[Moses-support] moses threads compilation problem (with RandLM)

Hi Alex,

unfortunately the randomized language model implementation is not yet thread-safe, so it is incompatible with the multi-threaded Moses. Only the SRILM interface is currently supported.

-phi

Re:[Moses-support] moses threads compilation problem (with RandLM)

Hi Alex

Philipp is correct, multi-threaded moses is unlikely to work with randlm since the latter uses a (presumably) non-thread-safe cache.

As regards the compile error, this is due to a recent change in the mbr code, and the fact that we don’t have a regression test to pick it up. I should be able to fix the compile error fairly quickly, but at the moment I’m not sure what to do about the regression test. Ideally I’d like to get rid of the separate main for mosesmt, although we’d still have to have compiler switches which would leave us open to these issues.

If you roll back to 2636 then mosesmt should compile fine.

You mentioned some “weird use of -DWITH_THREADS” – do you mean the failure of (eg) the test of Ngram.h ? I think this is due to a different problem with configure.ac, which would explain why I keep seeing errors like “WARNING: Ngram.h: accepted by the compiler, rejected by the preprocessor!” !

cheers
Barry

NOTICE:This is digested from the Moses-support mailing list, which supports for the moses SMT decoder.

Related posts:

1. Moses Support Digest:mt3_chart compilation error
2. Moses Support Digest:Moses compilation problem on fedora 11
3. Moses Support Digest: moses_chart and recaser phrase-table
4. Moses Support Digest:problem running mosesserver
5. Moses Support Digest:Multi-threaded Moses
6. Moses Support Digest:The results of your email commands
7. Moses Support Digest:CreateBerkeleyPt and On-Disk Rule Table
8. Moses Support Digest:moses for cygwin
9. Moses Support Digest:compiling moses 3 chart
10. Moses Support Digest:Tuning failure with Language model type unknown