apache / apache/datafusion

Tracking: speed up the logical optimizer

Open
#15,775 2 comments 3 reactions 1 assignee Claimed by @xudong963 View on GitHub
performance
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

I plan to speed up the logical optimizer from two aspects:
1. Try to reduce the optimization rounds by making each rule generate the best plan as much as possible
2. Optimize the single rule's plan time.

The issue mainly tracks a to-do list, and anyone interested in the topic can follow it.

- [x] https://github.com/apache/datafusion/pull/15761
- [x] https://github.com/apache/datafusion/pull/15744
- [x] https://github.com/apache/datafusion/pull/15735
- [x] https://github.com/apache/datafusion/pull/15746
- [x] https://github.com/apache/datafusion/pull/15787
- ~~[ ] TBD~~

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.