apache / apache/beam

SQL DSL stage name should probably be named application nodes

Open
#18,636 0 comments 0 reactions 0 assignees View on GitHub
dsl improvement P3 sql
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Currently, the SQL DSL expansion uses its own custom out-of-band way of assigning hierarchical names to the transforms. But Beam already has hierarchical transforms with names, and these are intended for use in APIs and UIs. We should see what the diff is between just using Beam's existing facilities and this SQL DSL "stage name" concept.

Imported from Jira [BEAM-3716](https://issues.apache.org/jira/browse/BEAM-3716). Original Jira may contain additional context.
Reported by: kenn.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by comparing the SQL DSL expansion's custom hierarchical stage-name mechanism with Beam's existing hierarchical transform facilities; done means documenting the differences and determining whether the existing facilities can replace the custom concept.

Written by the indexing model from the issue text.

Assessment

Tech stack
sql
Domain
data-engineering
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.