apache / apache/gravitino-playground

Add Flink-Hive use case in the Jupyter notebook

Open
#91 0 comments 3 reactions 1 assignee Claimed by @TungYuChiang View on GitHub
Dominant language
Jupyter Notebook
Stars
83
Forks
55
Avg merge
8h 39m
Merged PRs (30d)
2

Description

**Feature Request:**
We propose adding a new Jupyter notebook to the `gravitino-playground` repository that demonstrates how to use the **Flink stream processing engine** to query a **Hive database**. The notebook will provide an example of setting up the PyFlink environment, connecting to a Hive database, executing queries, and displaying the results. This feature will showcase how to leverage Flink and Hive in a Jupyter notebook environment.

**Requirements:**
1. **Set up PyFlink Environment**: Integrate the PyFlink API and configure the Flink environment.
2. **Connect to Hive Database**: Set up the connection between Flink and Hive, and demonstrate how to execute queries on the Hive database.
3. **Query and Result Presentation**: Write example queries and display the results within the notebook.

**Resources for Reference:**
- [PyFlink Table API Documentation](https://nightlies.apache.org/flink/flink-docs-master/docs/dev/python/table/intro_to_table_api/)
- [Flink Integration Test Example](https://github.com/apache/gravitino/blob/main/flink-connector/flink/src/test/java/org/apache/gravitino/flink/connector/integration/test/FlinkEnvIT.java)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.