apache / apache/sedona-db

python: Expose laz reader in Python bindings

Open
#595 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
503
Forks
61
Avg merge
2d 5h
Merged PRs (30d)
91

Description

After https://github.com/apache/sedona-db/pull/471, we have an laz reader thanks to @b4l!

I think packaging pointcloud readers and future possible writers should be done in a separate Python package...even though it could be done by building everything into the main Python package, at some point we have to start separating things and DataFusion provides some great utilities to do this.

I think the initial version of this could expose a listing table (table provider) or user-defined table function and leverage the existing DataFusion FFI utilities. I think these went through some significant changes in DataFusion 52, so it may be best to wait until then to ensure spatial predicates can make their way through for pruning.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing laz reader from PR #471 and DataFusion’s FFI utilities, focusing on the proposed separate Python package and table-provider or user-defined table function. Done means agreeing on and implementing a Python-facing listing table or UDTF that exposes the laz reader and supports spatial-predicate pruning; no source files or tests are named.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, rust
Domain
api, database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.