huggingface / huggingface/dataset-viewer

Apply recommendations from duckdb to improve speed

Open
#2,882 1 comment 0 reactions 0 assignees View on GitHub
improvement / optimization P2
Dominant language
Python
Stars
899
Forks
130
Avg merge
9h 26m
Merged PRs (30d)
14

Description

DuckDB has a dedicated page called "My Workload Is Slow"

https://duckdb.org/docs/guides/performance/my_workload_is_slow

and more generally all the https://duckdb.org/docs/guides/performance/overview section.

It could be good to review if some recommendations apply to our usage of duckdb.

Contributor guide

Open the contributing guide

Research direction

Start with DuckDB's "My Workload Is Slow" guide and the performance overview linked in the issue, then inspect how this repository uses DuckDB. Done means identifying applicable recommendations, applying the relevant changes, and demonstrating that they improve speed.

Written by the indexing model from the issue text.

Assessment

Domain
databases
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.