apache / apache/pinot

Build AWS Glue connector for Pinot

Open
#8,527 4 comments 0 reactions 1 assignee Claimed by @ddcprg View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

AWS Glue has support for custom data source integration via connectors

https://aws.amazon.com/blogs/big-data/developing-testing-and-deploying-custom-connectors-for-your-data-stores-with-aws-glue/

An AWS Glue connector for Pinot would allow adding full SQL support using managed services like Athena, saving operational time on alternatives like Trino or Presto, and expanding the set of choices for users to select from. This also allows joining data sets from different sources the same way is done with Trino.

This ticket is to track progress on this work.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.