apache / apache/beam

[Task]: Dataframe API notebook - remove custom install

Open
#23,961 0 comments 0 reactions 0 assignees View on GitHub
dataframe dsl P2 task
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What needs to happen?

Right now, we're custom installing Beam latest in our Dataframe notebook - https://github.com/apache/beam/blob/5c3d64747733747ba1f39fdf2c3877e733825e1f/examples/notebooks/beam-ml/dataframe_api_preprocessing.ipynb?short_path=1907d0f#L100 - once 2.43 is released we should update to just install 2.43 directly.

### Issue Priority

Priority: 2

### Issue Component

Component: dsl-dataframe

Contributor guide

Open the contributing guide

Research direction

Open examples/notebooks/beam-ml/dataframe_api_preprocessing.ipynb and inspect the installation cell around the linked line. Replace the custom Beam installation with a direct install of version 2.43, then run the notebook to confirm the installation and preprocessing workflow still work.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Refactor
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.