apache / apache/beam

[Feature Request]: Make options available in Group schema transforms.

Open
#22,729 0 comments 0 reactions 0 assignees View on GitHub
core java new feature P2
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What would you like to happen?

One powerful tool of schemas is the `group` transform and the associated aggregate transforms. In #20022, schema options were introduced as a way to provide details to fields.

As a user, I would like to be able to write `aggregateField` transforms in a way that allows me to create schema options for an output field programmatically based on the schema options of the input fields.
This could be very useful for data provenance across transforms.
For example, a user may want to indicate that a particular upstream dataset was used in the generation of the value of a particular field. Another use case would be to propagate that a particular schema field has been deprecated.

### Issue Priority

Priority: 2

### Issue Component

Component: sdk-java-core

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.