MT Exercise 4: Layer Normalization for Transformer Models

This repo is just a collection of scripts showing how to install JoeyNMT, download data and train & evaluate models.

Requirements

• This only works on a Unix-like system, with bash.

• Python 3 must be installed on your system, i.e. the command python3 must be available

• Make sure virtualenv is installed on your system. To install, e.g.

  pip install virtualenv

Steps

Clone this repository or your fork thereof in the desired place:

git clone https://github.com/emmavdbold/mt-exercise-4

Create a new virtualenv that uses Python 3. Please make sure to run this command outside of any virtual Python environment:

./scripts/make_virtualenv.sh

Important: Then activate the env by executing the source command that is output by the shell script above.

Download Moses for post-processing:

./scripts/download_install_packages.sh

Download data:

./scripts/download_preprocessed_data.sh

Before training a model, you need to install joeynmt within the virtual environment. Please refer to the exercise instructions for the details.

Train a model:

./scripts/train.sh

The training process can be interrupted at any time, and the best checkpoint will always be saved.

Evaluate a trained model with

./scripts/evaluate.sh