apache / apache/fluss

[Umbrella] FIP-17: Support Full KV Scan for Primary Key Tables

Open
#1,600 12 comments 0 reactions 1 assignee Assigned to @polyzos View on GitHub
component=kv
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

Fluss KV currently supports point lookups, but RocksDB allows iterators, range, and prefix scans.

For small tables (hundreds of rows or a few thousands), that can be used to create dashboards often need to periodically read all keys.

**Goal:** Assume I have a front-end and I want to create a dashboard to show < 1-2k values.. In this scenario, I could use the fluss client directly to periodically query the whole kv store

### Solution

We can expose functionality to the api to allow a full scan (with snapshot consistency) to simplify such use cases.

-------------------
An implementation can be found [here](https://github.com/apache/fluss/pull/2809) and for easier reviews it can be broken down to the following individuals PRs:

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.