datafusion-contrib / datafusion-contrib/liquid-cache
API to check the liquidCache entries
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 452
- Forks
- 51
- Avg merge
- 3h 10m
- Merged PRs (30d)
- 12
Description
Recently datafusion created the following API for metadata cache: https://github.com/apache/datafusion/pull/17126
Currently LiquidCache exposes the following metrics:
#[derive(Clone, PartialEq, serde::Serialize, serde::Deserialize, Debug)]
pub struct ExecutionMetricsResponse {
pub pushdown_eval_time: u64,
pub cache_memory_usage: u64,
pub liquid_cache_usage: u64,
}
We can enhance it with an API close to what datafusion has to get more insights on the liquidCache data
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing DataFusion PR 17126 and the existing ExecutionMetricsResponse definition shown in the issue. Determine which liquidCache entry details the new API should expose and how its response should align with the DataFusion metadata-cache API. Done means the proposed API provides useful liquidCache insights beyond the existing metrics.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend-api-design
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100