apache / apache/texera

Need Validation on UDF Ports

Open
#2,078 2 comments 0 reactions 1 assignee Assigned to @Yicong-Huang View on GitHub
Dominant language
Scala
Stars
314
Forks
187
Avg merge
1d 21h
Merged PRs (30d)
214

Description

Currently there are a few problems with UDF ports:

image

1. A user can connect multiple inputs to the same port of a UDF, but they can potentially have different schema.
2. A UDF's input can accept outputs from a downstream operator, resulting in a cycle.

They will not be validation errors now, i.e., a user can submit such workflows. But they will run into runtime problems.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.