apache / apache/polaris-tools

Enhancement request - Metadata->Manifest list->Manifest file -> Parquet files.

Open
#109 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
33
Forks
46
Avg merge
1d 4m
Merged PRs (30d)
2

Description

Sorry, I don't see a enhancement request option, like what's on the main Polaris project.

It would really be great to expose the Manifest file, Manifest lists, and associated parquet files, on a table...

Think thats where things could become amazing.

This data set, makes perfect option for a tree view.

Show at the root the table name, then the metadata file name (which is shown atm), but then show the manifest list, as child pointers, followed by Manifest files for the manifest list, and below that the parquet files thats owned by the manifest file.

This is where a xMas request comes in... allow user to click on the various levels, exposing the contained data on the main right pane.
When we click on the parquet file, show all information excluding the actual records, aka, all meta data, table structure, min, max values, record count etc.

G

Image

Contributor guide

No contributing guide indexed for this repository

Research direction

The request describes a tree from the table and metadata through manifest lists, manifest files, and Parquet files, with details shown in the right pane. No files, tests, or entry points are named; first inspect the existing metadata display, then determine the scope and acceptance criteria for the hierarchy and metadata views.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
data, frontend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.