Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow updating existing documents #36

Open
3 tasks
sinedied opened this issue Apr 9, 2024 · 0 comments
Open
3 tasks

Allow updating existing documents #36

sinedied opened this issue Apr 9, 2024 · 0 comments
Assignees
@sinedied
Labels
backend enhancement New feature or request

Comments

@sinedied
Copy link
Contributor

sinedied commented Apr 9, 2024 •
edited

Currently if you upload the same document twice, it will create duplicated chunks of the same documents.
Before add a document to the database, we should remove all chunks related to the document using its filename as ID to avoid duplication and allow updates.

Tasks

  • Remove all chunks with the same filename of uploaded document in POST /documents
    • for Azure ComosDB for MongoDB vCore path
    • for FAISS path when running locally
@sinedied sinedied added enhancement New feature or request backend labels Apr 9, 2024
@sinedied sinedied self-assigned this Apr 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sinedied sinedied

Labels
backend enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sinedied