New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MiniLLM] llama3-instruct版本蒸馏 #244

Open

Yjonben opened this issue Jul 11, 2024 · 1 comment

Yjonben commented Jul 11, 2024

我如果想在dolly数据集上进行teacher：llama3-70b-instruct，student：llama3-8b-instruct。的蒸馏，是否需要修改某些代码逻辑或者dolly数据集的template？

Yjonben changed the title ~~llama3-instruct版本蒸馏~~ 【MINILLM】llama3-instruct版本蒸馏

Yjonben changed the title ~~【MINILLM】llama3-instruct版本蒸馏~~ [MiniLLM] llama3-instruct版本蒸馏

ypw-lbj commented Aug 13, 2024

Did you succeed?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment