datafusion-contrib / datafusion-contrib/liquid-cache
Parquet viewer integration
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 452
- Forks
- 51
- Avg merge
- 3h 10m
- Merged PRs (30d)
- 12
Description
I think Parquet viewer (https://parquet-viewer.xiangpeng.systems) is our natural first customer, a perfect fit for disaggregated cache.
We should add a new tab to the parquet viewer:
We should deploy a community server, probably on Cloudflare, that will download folks public parquet data and cache them locally.
It not only benefits Parquet viewer users, but also helps us learn what query/parquet people use.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the Parquet viewer at https://parquet-viewer.xiangpeng.systems and the repository's existing cache and object-store integration. Clarify the new tab's interface and the scope of a community server, including the proposed Cloudflare deployment. Done means an agreed integration design and a deployed server that can cache public Parquet data.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- cloud, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100