Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Flink-Hive use case in the Jupyter notebook #91

Open
TungYuChiang opened this issue Oct 29, 2024 · 0 comments
Open

Add Flink-Hive use case in the Jupyter notebook #91

TungYuChiang opened this issue Oct 29, 2024 · 0 comments
Assignees
@TungYuChiang

Comments

@TungYuChiang
Copy link

TungYuChiang commented Oct 29, 2024 •
edited
Loading

Feature Request:
We propose adding a new Jupyter notebook to the gravitino-playground repository that demonstrates how to use the Flink stream processing engine to query a Hive database. The notebook will provide an example of setting up the PyFlink environment, connecting to a Hive database, executing queries, and displaying the results. This feature will showcase how to leverage Flink and Hive in a Jupyter notebook environment.

Requirements:

  1. Set up PyFlink Environment: Integrate the PyFlink API and configure the Flink environment.
  2. Connect to Hive Database: Set up the connection between Flink and Hive, and demonstrate how to execute queries on the Hive database.
  3. Query and Result Presentation: Write example queries and display the results within the notebook.

Resources for Reference:
@TungYuChiang TungYuChiang changed the title Add Flink use case in the Jupyter notebook Add Flink-Hive use case in the Jupyter notebook Nov 3, 2024
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 3, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
7ff5b5b 
This commit adds a Flink-Hive use case to the Jupyter notebook
The following dependencies were installed to support this integration:

- flink-sql-connector-hive-2.3.10_2.12-1.20.0.jar
- gravitino-flink-1.18_2.12-0.6.1-incubating.jar
- gravitino-flink-connector-runtime-1.18_2.12-0.6.1-incubating.jar
- Hadoop
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 4, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
ad5c72b 
This commit adds a Flink-Hive use case to the Jupyter notebook
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 5, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
440ffd2 
This commit adds a Flink-Hive use case to the Jupyter notebook
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 5, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
eda73f5 
This commit adds a Flink-Hive use case to the Jupyter notebook
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 5, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
2068f38 
This commit adds a Flink-Hive use case to the Jupyter notebook
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 5, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
833c4e0 
This commit adds a Flink-Hive use case to the Jupyter notebook
TungYuChiang added a commit to TungYuChiang/gravitino-playground that referenced this issue Nov 5, 2024
@TungYuChiang
Add Flink-Hive use case in Jupyter notebook (apache#91)
df2fc17 
This commit adds a Flink-Hive use case to the Jupyter notebook
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@TungYuChiang TungYuChiang

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@TungYuChiang