datafusion-contrib / datafusion-contrib/liquid-cache
[Bug] TPC-DS has some failed test
Open
Nobody has claimed this yet.
help wanted
- Dominant language
- Rust
- Stars
- 452
- Forks
- 51
- Avg merge
- 3h 10m
- Merged PRs (30d)
- 12
Description
Liquid-cache has a tpcds ( #448 ). However, there remains some failed test.
- q10, q18, q31, q54, q81: DataFusion planning bug on customer_address; column
ca_countyreferenced but input schema seen as single column. - q23: DataFusion planning bug on date_dim; column
d_yearreferenced but input schema seen as single column. - q37: DataFusion planning bug on item; column
i_manufact_idmissing due to truncated schema. - q45: DataFusion IN list type mismatch (Utf8 vs Int64) triggers assertion.
- q53: DataFusion planning bug on item; column
i_classmissing due to truncated schema. - q63: DataFusion planning bug on item; column
i_classmissing due to truncated schema. - q64: DataFusion planning bug on item; column
i_colormissing due to truncated schema (expected 3 columns but only 2 present: ["i_item_sk", "i_product_name"]). - q72: DataFusion type coercion error; Date32 + Int64 arithmetic expression cannot be coerced to valid types (date arithmetic compatibility issue).
- q73: DataFusion planning bug on store; column 's_county' missing due to truncated schema (expected multiple columns but only 1 present: ["s_store_sk"]).
How to reproduce this:
env RUST_LOG=info cargo run --bin tpcds_client -- --manifest benchmark/tpcds/manifest.muted.json --answer-dir benchmark/tpcds/answers/sf0.1
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by running the provided cargo run command for benchmark/tpcds/manifest.muted.json and benchmark/tpcds/answers/sf0.1, then inspect the failures for q10, q18, q31, q54, q81, q23, q37, q45, q53, q63, q64, q72 and q73. Done means the TPC-DS run no longer reports these schema, type-mismatch, or date-arithmetic failures.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100