apache / apache/paimon

[Feature] Support querying system tables by dynamic options

Open
#5,042 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Motivation

Currently, if user want to query a system table, the SQL would be like

`SELECT * FROM data_table$system_table`

The system table and data table is separated by `$`. This is not convenient to extend for different query engines. For example, some query engine may throw syntax error for `$` character, some may have extra check and require `data_table$system_table` exists in metastore.

It would be better if system tables can be queried by dynamic options. It's easier to extend for different query engine.

### Solution

_No response_

### Anything else?

_No response_

### Are you willing to submit a PR?

- [x] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points; start by locating the system-table query handling and how dynamic options are represented for query engines. Done means system tables can be queried through dynamic options without requiring the table$system_table syntax, with coverage for the supported query-engine paths.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, sql
Domain
backend-api-design, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.