Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: abstract the MetricsEvaluator #674

Open
sundy-li opened this issue Oct 18, 2024 · 1 comment
Open

feat: abstract the MetricsEvaluator #674

sundy-li opened this issue Oct 18, 2024 · 1 comment

Comments

@sundy-li
Copy link
Contributor

Every query engine has its expression framework to prune files.

The current Predicate in iceberg-rust is very simple, it's not powerful yet.

For example, it does not support Cast Expression and other complex expression.
such as: filter = abs( cast(id2 as int) ) > id2

Though this filter is rarely used, query engine can make its own effort to calculate the domain based on the stats (Such as ConstantFolder framework in databend)

@liurenjie1024
Copy link
Contributor

Good point, I believe this could be achieved by allowing injecting metrics evaluator into table scan planning to help pruning more unnecessary data files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants