dask / dask/dask-expr

We can not handle collections in kwargs for UDFs

Open
#788 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
89
Forks
26
PR merge metrics
No merged PRs in 30d

Description

If a user uses a UDF that expects kwargs that are collections, then we can't handle this at the moment. This is a general issues for stuff like:

- map_partitions
- groupby.apply/transform
- map
- apply
- ...

This is a general problem that we should try to solve

Contributor guide

Open the contributing guide

Research direction

Start by tracing how kwargs are handled across the listed UDF entry points: map_partitions, groupby.apply/transform, map, and apply. Define the expected behavior for collection-valued kwargs and verify that the solution works consistently across these operations.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.