map_rect functions aren't able to make use of vectorized forms
@seantalts is already working on this.
Since Jul 26, 2018.
- Dominant language
- C++
- Stars
- 839
- Forks
- 220
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 14
Description
Summary:
map_rect needs a vectorized version, essentially.
Description:
Right now, map_rect specifies that it takes in a function that operates on a single row of a dataset, even if a node is executing that code on a much larger chunk of data at once. We can find speed improvements if we create a version that specifies a user defined function that operates on a chunk of data instead of a single row.
Expected Output:
A new map_rect type signature where the UDF takes in a vector and likely has controllable chunk sizes or chunking broadly.
Tagging @wds15 and @yizhang-cae - either of you have a semi-realistic but fake data set and model that is useful for something like this? I guess it'd be anything with a ton of observations on a vectorized lpdf.
Current Version:
v2.18.0
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.