apache / apache/sedona-db

Add support for metadata bounding box in GeoParquet writer

Open
#357 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
503
Forks
61
Avg merge
2d 4h
Merged PRs (30d)
90

Description

In https://github.com/apache/sedona-db/pull/175 / https://github.com/apache/sedona-db/issues/138 we improved support for GeoParquet writing; however, we can't add the bbox to the key/value metadata without copying a huge chunk of the Parquet writer into SedonaDB and so I didn't implement that as a first step (the workaround is to write GeoParquet 1.1 which allows readers to better prune row groups anyway).

Also related is #133 (support for Parquet GEOMETRY/GEOGRAPHY) which is orthogonal to this particular issue but we should tackle first because it affects the code we need to copy. We can tackle that issue when we upgrade to DataFusion 51.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing pull request #175 and issue #138 to understand the existing GeoParquet writer support, then read issue #133 and the DataFusion 51 upgrade context. Identify the Parquet writer code that must be copied or adapted for key/value metadata. Done means the GeoParquet writer emits metadata containing the metadata bounding box without regressing the related geometry support.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.