You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Firstly, thank you so much for supporting this library, I have been finding it really useful!
I have a usecase where I need to limit the payload size when invoking an inference service. Because of this, it would be useful that the handSubmit function exposed by the useChat hook allowed to either omit the conversation history from the request (and only pass the latest user prompt), or allowed to override the conversation history that is passed. (So that, for example, I could only pass the first 15 words of each message.)
Right now, I see the library's API doesn't allow for that, but I was wondering if in principle it is something you would be willing to support? I made a sample PR, happy to take feedback :) #1468
Use Case
Limiting payload size when back-end service imposes this kind of limit. Eg: AWS CloudFront when intercepting requests with ViewerRequest Lambda@Edge function associations imposes a 40kb limit after which the request is truncated.
Additional context
No response
The text was updated successfully, but these errors were encountered:
Feature Description
Hi Team,
Firstly, thank you so much for supporting this library, I have been finding it really useful!
I have a usecase where I need to limit the payload size when invoking an inference service. Because of this, it would be useful that the
handSubmit
function exposed by theuseChat
hook allowed to either omit the conversation history from the request (and only pass the latest user prompt), or allowed to override the conversation history that is passed. (So that, for example, I could only pass the first 15 words of each message.)Right now, I see the library's API doesn't allow for that, but I was wondering if in principle it is something you would be willing to support? I made a sample PR, happy to take feedback :) #1468
Use Case
Limiting payload size when back-end service imposes this kind of limit. Eg: AWS CloudFront when intercepting requests with ViewerRequest Lambda@Edge function associations imposes a 40kb limit after which the request is truncated.
Additional context
No response
The text was updated successfully, but these errors were encountered: