-
Notifications
You must be signed in to change notification settings - Fork 323
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* multi index leaf search request execute one request per node, instead one request per index. A leaf can receive now request over multiple indices. Especially in cases with search requests on many indices this saves a lot of requests and therefore memory. It also allows better control of the memory consumption of a requests on a node, if it is not split up over multiple requests. * introduce IntermediateLeafResult LeafSearchResponse includes serialized aggregations to send them between nodes. This is used also on a leaf, which causes the results to be serialized and then deserialized for merging again _per_ split. This PR introduces IntermediateLeafResult to be used instead. It also adds a field `aggregation_type` to LeafSearchResponse to be able to convert self contained between IntermediateLeafResult and LeafSearchResponse. * multiple incremental collectors, pass agg limits * Revert "introduce IntermediateLeafResult" This reverts commit c968e4d. * fmt, cleanup * remove outer incremental collector * cleanup * fix test * fix test * cleanup * minor fixes * clippy
- Loading branch information
Showing
11 changed files
with
578 additions
and
194 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
34 changes: 26 additions & 8 deletions
34
quickwit/quickwit-proto/src/codegen/quickwit/quickwit.search.rs
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.