Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Token Calculation Warning for "qwen-plus" Model in Letta Library #2142

Open
ccxx2017 opened this issue Dec 3, 2024 · 0 comments
Open

Token Calculation Warning for "qwen-plus" Model in Letta Library #2142

ccxx2017 opened this issue Dec 3, 2024 · 0 comments

Comments

@ccxx2017
Copy link

ccxx2017 commented Dec 3, 2024

When using Letta with the Qwen-plus model, I consistently encounter the following warning:

d:\AI-practicing\Lettagent\env-letta-agent\Lib\site-packages\letta\local_llm\utils.py:215: UserWarning: num_tokens_from_messages() is not implemented for model qwen-plus. See https://github.com/openai/openai-python/blob/main/chatml.md for information on how messages are converted to tokens.
warnings.warn(
Warning: model not found. Using cl100k_base encoding.
Additional Observations:

The warning appears in the local_llm/utils.py file
It suggests that token calculation method is not implemented for the qwen-plus model
The system defaults to using cl100k_base encoding

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant