[EPIC] More Async User Defined Function work
- Dominant language
- Rust
- Stars
- 9.3k
- Forks
- 2.4k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 344
Description
In https://github.com/apache/datafusion/issues/6518 and https://github.com/apache/datafusion/pull/14837, @goldmedal introduced async user defined functions. This ticket captures follow on work to improve the functionality:
- [x] https://github.com/apache/datafusion/issues/16521
- [x] https://github.com/apache/datafusion/issues/16522
- [ ] https://github.com/apache/datafusion/issues/16525
- [x] https://github.com/apache/datafusion/issues/17619
- [ ] Join expression
- [ ] Async UDAF
- [ ] Async UDWF
- [ ] Async UDTF
- [ ] https://github.com/apache/datafusion/issues/18150
- [x] https://github.com/apache/datafusion/issues/19112
- [x] https://github.com/apache/datafusion/issues/19623
- [ ] https://github.com/apache/datafusion/issues/20031
Contributor guide
Research direction
Start by reading the async user-defined function design in issue #6518 and pull request #14837, then review the linked follow-up issues from this epic. Focus on the unchecked items, including join expressions and async UDAF, UDWF, and UDTF support. Done means the remaining checklist items are implemented and their linked issues are resolved.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend-api-design, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100