-
Notifications
You must be signed in to change notification settings - Fork 237
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Baichuan13B vllm 效果很差 #202
Comments
需要根据api_server.py实现,在request中增加top_p、repetable_penality等参数,另外需要设置chat-template为baichuan |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
启动脚本
client
The text was updated successfully, but these errors were encountered: