[C++][Python] UDF Optimizations
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 91
Description
Need an interface to evaluate the memory footprint, execution time and health of the UDFs and return a meaningful status ex: `Status::HighMemoryUsageException()`, `Status::TimeLimitException()`
Note: This is also aligned with resource monitoring in the parallel execution space.
**Reporter**: [Vibhatha Lakmal Abeykoon](https://issues.apache.org/jira/browse/ARROW-15637) / @vibhatha
**Note**: *This issue was originally created as [ARROW-15637](https://issues.apache.org/jira/browse/ARROW-15637). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*
Contributor guide
Research direction
Start by locating the UDF execution paths and the parallel execution resource-monitoring work referenced in the issue. Define how memory footprint, execution time, and health should be evaluated and which meaningful status outcomes are required; the work is done when UDFs expose this monitoring interface and return the agreed statuses.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100