apache / apache/datafusion

[EPIC] Improve Pathalogical Planning times

Open
#17,493 0 comments 1 reaction 0 assignees View on GitHub
enhancement PROPOSAL EPIC
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Is your feature request related to a problem or challenge?

There are certain parts of the DataFusion planner that take a long time with certain query patterns. This often seems to come from algorithmic properties such as certain calculations being exponential in various input dimensions

This epic collects related tickets

- [x] https://github.com/apache/datafusion/issues/17401
- [ ] https://github.com/apache/datafusion/issues/17261
- [x] https://github.com/apache/datafusion/issues/13748

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the DataFusion planner context and the three linked issues, especially the unchecked #17261 item. Determine which planner time complexity remains to be addressed; this epic is complete when the related tickets are resolved and its checklist is updated.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.