aws / aws/containers-roadmap

[EMR on EKS] Interactive analytics using EMR on EKS

Open
#1,727 0 comments 1 reaction 0 assignees View on GitHub
EKS EMR Proposed
Dominant language
Shell
Stars
5.4k
Forks
334
PR merge metrics
No merged PRs in 30d

Description

Enable interactive analytics in EMR on EKS via Jupyter notebooks and EMR Studio

**Which service(s) is this request for?**
EMR on EKS

To enable interactive analytics use-cases, EMR on EKS is building functionality that allows you to connect EMR Studio, a free to use visual IDE for analytics, to your EMR on EKS clusters. With this feature, you can use Scala, SQL, or Python to submit interactive jobs to EMR on EKS, as well as debug your applications using familiar open source tools such as Spark UI. EMR Studio also enables you to collaborate with your teammates in real-time. Additionally, this feature will enable you to also invoke your notebooks as part of your ETL/ELT pipelines using an API.

Contributor guide

Open the contributing guide

Research direction

The issue provides no repository files, tests, or implementation entry point. Start by reviewing the EMR on EKS and EMR Studio interactive analytics requirements; done would mean supporting notebook-based interactive jobs, Spark UI debugging, collaboration, and notebook API invocation.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, jupyter-notebook, kubernetes, python, scala, sql
Domain
cloud, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.