quickwit-oss / quickwit-oss/quickwit
[Feature] Add SQL with Arrow Flight SQL
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
Is your feature request related to a problem? Please describe.
Fast sql unified data access.
Describe the solution you'd like
Arrow Flight SQL which gives possiblilities to retrieve data faster and also make a one unified standard driver to access.
Describe alternatives you've considered
Actually there is no such.
Additional context
There is new modern SQL way to retrieve data in a faster way through Arrow Flight SQL driver.
There will be no need (it seams to be no) to have python or other kind of clients to access.
https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html#
https://arrow.apache.org/blog/2022/02/16/introducing-arrow-flight-sql/
https://www.postgresql.org/about/news/apache-arrow-flight-sql-adapter-for-postgresql-010-2716/
Some explanations and research:
https://www.vldb.org/pvldb/vol10/p1022-muehleisen.pdf
Some server examples:
https://github.com/voltrondata/flight-sql-server-example
https://www.kamu.dev/blog/2023-09-datafusion-flightsql/ https://github.com/kamu-data/kamu-cli
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no repository files, tests, or entry points. Start by reviewing the linked Arrow Flight SQL documentation, PostgreSQL adapter, and server examples, then inspect Quickwit’s existing query and data-access interfaces. Done would require a defined integration scope, implementation plan, and validation for unified Arrow Flight SQL access.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust, sql
- Domain
- api, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 32/100