quickwit-oss / quickwit-oss/quickwit

[Feature] Add SQL with Arrow Flight SQL

Open
#4,052 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Rust
Stars
11.7k
Forks
597
Avg merge
2d 22h
Merged PRs (30d)
37

Description

Is your feature request related to a problem? Please describe.
Fast sql unified data access.

Describe the solution you'd like
Arrow Flight SQL which gives possiblilities to retrieve data faster and also make a one unified standard driver to access.

Describe alternatives you've considered
Actually there is no such.

Additional context
There is new modern SQL way to retrieve data in a faster way through Arrow Flight SQL driver.
There will be no need (it seams to be no) to have python or other kind of clients to access.

https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html#
https://arrow.apache.org/blog/2022/02/16/introducing-arrow-flight-sql/
https://www.postgresql.org/about/news/apache-arrow-flight-sql-adapter-for-postgresql-010-2716/

Some explanations and research:
https://www.vldb.org/pvldb/vol10/p1022-muehleisen.pdf

Some server examples:
https://github.com/voltrondata/flight-sql-server-example
https://www.kamu.dev/blog/2023-09-datafusion-flightsql/ https://github.com/kamu-data/kamu-cli

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no repository files, tests, or entry points. Start by reviewing the linked Arrow Flight SQL documentation, PostgreSQL adapter, and server examples, then inspect Quickwit’s existing query and data-access interfaces. Done would require a defined integration scope, implementation plan, and validation for unified Arrow Flight SQL access.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, sql
Domain
api, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.