Json support in clickbench benchmark
- Dominant language
- Rust
- Stars
- 9.3k
- Forks
- 2.4k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 344
Description
### Is your feature request related to a problem or challenge?
There's `data_clickbench_1` and `run_clickbench_1` in ~/work/datafusion/benchmarks/bench.sh;
we should have a `data_clickbench_2`, or `data_clickbench_1_json` that uses the following:
URL="https://datasets.clickhouse.com/hits_compatible/hits.json"
And add support for json in `benchmarks/src/clickbench.rs`
### Describe the solution you'd like
something like: https://github.com/ariel-miculas/datafusion/tree/json-test-on-main
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
Contributor guide
Research direction
Start with ~/work/datafusion/benchmarks/bench.sh, comparing data_clickbench_1 and run_clickbench_1, then read benchmarks/src/clickbench.rs. Use the hits.json dataset URL from the issue and review the linked json-test-on-main example. Done means the benchmark scripts include the JSON dataset and clickbench.rs supports running it.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- performance, testing-qa
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 58/100