Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PROBLEM: alignment is 0. #225

Open
Rexbalaeniceps opened this issue Dec 4, 2021 · 2 comments
Open

PROBLEM: alignment is 0. #225

Rexbalaeniceps opened this issue Dec 4, 2021 · 2 comments

Comments

@Rexbalaeniceps
Copy link

hello~ Some problems have occurred in the file training.out after running the following script:

 nohup nice /data/wbxu/mosesdecoder/scripts/training/train-model.perl -root-dir train \
 -corpus /data/wbxu/wmt14/wmt14_ende/train.en-de.clean                            \
 -f de -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe \
 -lm 0:3:/data/wbxu/excute_moses/train.en-de.blm.en:8                          \
 -external-bin-dir /data/wbxu/mosesdecoder/tools >& training.out &
PROBLEM: alignment is 0.
WARNING: Model2 viterbi alignment has zero score.
Here are the different elements that made this alignment probability zero 
Source length 79 target length 100

I use the train dataset from fairseq distillation. Please tell me why those problems appeared, thanks very much~

@hieuhoang
Copy link
Contributor

this is quite difficult to debug from an email. My advise is to figure out the exact giza++ command that is being called and drill down from there

@Rexbalaeniceps
Copy link
Author

Thanks for your response~ But I cannot fully understand your advice as I am a new hand. Could you explain more detail for me , thank you very much~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants