Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support typesense like facet #55

Merged
merged 11 commits into from
Jan 10, 2025
Merged

Support typesense like facet #55

merged 11 commits into from
Jan 10, 2025

Conversation

arkohut
Copy link
Owner

@arkohut arkohut commented Dec 30, 2024 •
edited
Loading

  1. Performance tuning for sqlite vec and support extra data filter.
  2. Typesense like facet support for app_name, but it is disabled by default for performance reason.
  3. Add webhook status tracking to prevent unnecessary rerun for plugins.
  4. Add indexing timestamp from last_scan_at to prevent unnecessary reindex.

arkohut added 11 commits December 9, 2024 17:23
@arkohut
feat(server): support tags filter
9a13f31
@arkohut
feat(server): support tags facets
43a8ed1
@arkohut
fix: stop when recreate vec table failed
ae530aa
@arkohut
feat(vec): new vec table support filter
30f58f0
@arkohut
feat(facet): read setting.facet
fbd1dd7
@arkohut
feat(facet): support app names instead of tags
3541ff9
@arkohut
feat: support migration with alembic
0f3c8bc
@arkohut
feat(vec): use new table vec_v2
09c765d
@arkohut
feat: add plugin processing status tracking and improve webhook handling
ba71889 
- Add EntityPluginStatusModel to track which plugins have processed each entity
- Modify webhook triggering to only process pending plugins
- Improve force update behavior in library scanning
- Update entity schema to include plugin processing status
@arkohut
refactor: optimize entity indexing and improve migration
ae70446 
- Implement selective reindexing based on timestamp comparison
- Simplify vector table migration script
- Improve error handling and code organization in batch indexing
- Add proper datetime handling for timestamps
@arkohut
feat: add file_created_at_timestamp for embedding table
51e3826
@arkohut arkohut changed the title [WIP] Support typesense like facet Support typesense like facet Jan 10, 2025
@arkohut arkohut merged commit f27fa4a into master Jan 10, 2025
@arkohut arkohut deleted the support-typesense-like-facet branch January 10, 2025 15:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@arkohut