-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Doubao "Query or prefix prompt is too long“ error #4452
Comments
It appears you're encountering an error due to the total number of tokens for your prompt and the model's response exceeding the Doubao model's context size in Dify version 0.6.8. To address this, you should:
The default token limit for the Doubao model is 4096 for both
|
After modifying the custom tokens configuration, I found that the model began to babble 😄 |
Self Checks
Dify version
0.6.8
Cloud or Self Hosted
Self Hosted (Source)
Steps to reproduce
Tests of various versions of Doubao have yielded "Query or prefix prompt is too long, you can reduce the prefix prompt, or shrink the max token, or switch to a llm with a larger token limit size."
The actual committed prompt length is nowhere near above the maximum limit, and I think this might be a bug.
✔️ Expected Behavior
Submit normally
❌ Actual Behavior
Query or prefix prompt is too long, you can reduce the prefix prompt, or shrink the max token, or switch to a llm with a larger token limit size.
The text was updated successfully, but these errors were encountered: