matrixorigin / matrixorigin/matrixone

[Tech Request]: Self tuned read

Open
#11,475 4 comments 0 reactions 1 assignee Claimed by @ck89119 View on GitHub
deferred kind/tech-request source/dev
Dominant language
Go
Stars
1.9k
Forks
311
Avg merge
1d 3h
Merged PRs (30d)
768

Description

### Is there an existing issue for the same feature request?

- [x] I have checked the existing issues.

### Is your feature request related to a problem?

Now we may have 2nd index, record column, etc, we want our reader to be self tuned/auto select best access path

### Describe the feature you'd like

Reader should automatically decide the best access path. Some of them maybe better/easier
to decide during optimization, some are better decided at run time.

1. reader should decide if we can skip (or agg) reading a object using metadata zonemap.
2. If there is a 2nd index, reader should choose if to use it.
3. If there is row store column, reader should choose to to read a row column or several column columns.
4. Decide column reading order -- highly selective column may filter out all rows therefore there will be no need to read the rest of the columns.

### Describe implementation you've considered

_No response_

### Documentation, Adoption, Use Case, Migration Strategy

_No response_

### Additional information

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.