[MiniLLM] Llama weights conversion

[aaab8b]

The checkpoints in the huggingface of Llama(13b,7b) seems cannot be directly loaded in the model when training MiniLLM since its not considered model parallelism. Is there any way to convert the weight to mp=4?

[t1101675]

We provide a script to convert the mp of a checkpoint. You can try it.