-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failure generating response #84
Comments
Token limit is 7000 characters. The source that is included (github) is ~273 tokens based on this tool. edit: Okay, my bad, so what you are saying is that the remaining sources add up to more than 7000 tokens. Do we have access to what those sources are? So that we can verify it? |
Yeah, but more like the next relevant source in addition with the most relevant (the single source shown) adds up to more than 7000 tokens. Yeah, on local you can disable the tokenEnforcer and see the sources used or log the sources before then. I ran the query again and these are the results with tokenEnforcer disabled. [0]: https://bitcoinops.org/en/topics/silent-payments source [1] token count is over 11,000. With token enforcer you have this (this is from the same prompt)
so it keeps removing sources from least relevant till it fits into the context window. |
problem
I'm not able to get an answer for "silent payments" but other queries work
deductions
Possible explanation: Token limit cuts off the remaining sources as they were too large
The text was updated successfully, but these errors were encountered: