We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ver. 1.75.2
User tag:</s>\n[INST] Assistant tag:[/INST]\n
Maybe the right thing to do User tag:</s>\n<s>\n[INST]
User tag:</s>\n<s>\n[INST]
Then the system prompt will have the form
<s> [INST]User's Instructions[/INST] Assistant's response </s>
That would make sense, I think.
The text was updated successfully, but these errors were encountered:
You'll have to check with @pandora-s-git who is from Mistral and contributed the new templates
Sorry, something went wrong.
Hi there, It is important to not include the newlines, if any question regarding the templates please take a look at the following document explaining all the details: https://github.com/mistralai/cookbook/blob/main/concept-deep-dive/tokenization/chat_templates.md
All these white spaces are of extreme importance if we want it to match perfectly with the expected tokens.
No branches or pull requests
ver. 1.75.2
Maybe the right thing to do
User tag:</s>\n<s>\n[INST]
Then the system prompt will have the form
That would make sense, I think.
The text was updated successfully, but these errors were encountered: