datafusion-contrib / datafusion-contrib/liquid-cache
API to pre warm specific columns in liquid cache
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 452
- Forks
- 51
- Avg merge
- 3h 10m
- Merged PRs (30d)
- 12
Description
Similar to https://github.com/XiangpengHao/liquid-cache/issues/109 where we are thinking to prefetch the files into disk cache. We can expose APIs to load particular parquet file column (present on disk or in data store) into in-memory Liquid.
@XiangpengHao thoughts on this?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading liquid-cache issue #109 and compare its proposed disk-cache prefetching with this issue's request for loading selected Parquet columns into in-memory Liquid. The scope is complete when a concrete API and behavior for columns located on disk or in the data store are defined and implemented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100