apache / apache/texera

Incorrect output tuple number of R-UDF & Performance Bottleneck

Open
#3,496 4 comments 0 reactions 2 assignees Assigned to @Yicong-Huang View on GitHub
Dominant language
Scala
Stars
314
Forks
187
Avg merge
1d 21h
Merged PRs (30d)
214

Description

For the following workflow:

![Image](https://github.com/user-attachments/assets/611b1105-f663-4964-84c5-0998a08e1461)

According to the user, the expected # of output tuples of the R UDF should be equal to the # of input tuples.

Also, It takes 5 mins in Python script, but 20 mins using the workflow. According to the user's observation, the R UDF and Sort operator is the bottleneck.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.