Build AWS Glue connector for Pinot
Open
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 189
Description
AWS Glue has support for custom data source integration via connectors
https://aws.amazon.com/blogs/big-data/developing-testing-and-deploying-custom-connectors-for-your-data-stores-with-aws-glue/
An AWS Glue connector for Pinot would allow adding full SQL support using managed services like Athena, saving operational time on alternatives like Trino or Presto, and expanding the set of choices for users to select from. This also allows joining data sets from different sources the same way is done with Trino.
This ticket is to track progress on this work.
Contributor guide
Assessment
This issue has not been assessed yet.