geopython / geopython/pygeofilter

DataFusion Evaluator

Open
#127 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
90
Forks
44
PR merge metrics
No merged PRs in 30d

Description

DataFusion is a SQL engine that builds on the Apache Arrow ecosystem and plugs into many modern RDBMS.

https://github.com/apache/datafusion

I think it would make an excellent, cloud native evaluator for pygeofilter. As an added bonus, this would open up the possibility of integrating with xarray-sql.

https://github.com/alxmrs/xarray-sql

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked Apache DataFusion and xarray-sql projects to understand the proposed integration. Then identify pygeofilter's evaluator extension points and define the expected behavior and tests for a DataFusion evaluator; the work is done when that integration is implemented and verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, sql
Domain
backend, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.