Apache Arrow ADBC
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 10/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Domain
- data
Research direction
Start by reading superseding issue #108, which the issue identifies as the replacement for this work. No files, tests, or entry points are named here; the original goal was efficient QuestDB-to-Arrow loading and zero-copy sharing, while done is covered by the newer native SQL driver work.
Written by the indexing model from the issue text.
Description
Note: This item has been superseded by #108 (High-performance egress with native SQL drivers), which delivers zero-copy, high-performance egress with tighter QuestDB integration.
Building the Apache Arrow ADBC driver for QuestDB. This follows the introduction of new UTF-8 type varchar, minimizing type conversions.
One direct improvement will be to load data from QuestDB into Arrow format very efficiently. Data Scientists and Quants will then be able to leverage Pandas, Polars, and other tools that are natively compatible with Arrow.
Zero-copy data sharing.
- Dominant language
- No language data
- Stars
- 7
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from questdb/roadmap
-
enterprise security
-
open source SQL
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
open source SQL
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
enterprise open format storage
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
enterprise high availability
Difficulty 5/5 Over a week Newbie friendliness 25/100
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
Schema-level dtype cannot be serialized: to_yaml raises RepresenterError, to_json raises TypeError Open
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
unionai-oss/pandera#2511 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
unitaryfoundation/qldpc-challenge#1651 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
statsmodels/statsmodels#10271 ·