Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AWS Bedrock Keeps "Forgetting" RAG Documents After First Exchange #101

Open
ldavis9000aws opened this issue Nov 23, 2024 · 0 comments
Open

Comments

@ldavis9000aws
Copy link

I've tested this with several fresh installations of the latest LibreChat via docker. In this scenario, I'm using AWS Bedrock and have configured the following variables in my .env file:

More info: https://www.librechat.ai/docs/configuration/rag_api

EMBEDDINGS_PROVIDER=bedrock
EMBEDDINGS_MODEL=amazon.titan-embed-text-v1
AWS_ACCESS_KEY_ID=xxx
AWS_SECRET_ACCESS_KEY=xxx

I added a file that is 6.93MB in size to a chat via the AWS Bedrock endpoint (Claude 3.5 Sonnett v2 model). After the first reply, if I ask it for additional details it says it can't see the document anymore. Same issue with files under 5MB, so it doesn't appear to be a size issue. I'm not seeing any obvious errors in the logs. It happens whether I use the default OpenAI embedding model or the Titan embedding model....

Again, I have 2 separate installations on different machines....not sure what's going on......

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant