frollapply could optionally use mirai+mori rather than base R parallel's fork
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 35/100
Research direction
Start with the linked frollapply documentation in man/frollapply.Rd and inspect the current parallel-processing behavior it describes. Work out the design for an optional mirai+mori backend alongside base R fork processing, including the suggested dependencies; done means parallel frollapply can use the alternative on Windows and other systems without fork support.
Written by the indexing model from the issue text.
Description
frollapply now uses base R's parallel package fork for parallel computation of FUN. Adding mirai and mori packages together it could provide an alternative backend for parallel processing in frollapply.
Cost of it means 2 extra suggested dependency (3 pkgs in total, including nanonext, dep of mirai).
Benefits are that parallel processing will work on Windows, and other OSes where fork is not available.
Moreover, posit workbenchmark is not handling fork well, so that could be an alternative for posit workbench users.
https://github.com/Rdatatable/data.table/blob/e26cf1b6b95474d90d3db462409e2d59e371b740/man/frollapply.Rd#L6
note that frollapply is still experimental which gives more freedom to re-work
- Dominant language
- R
- Stars
- 3.9k
- Forks
- 1.1k
- Avg merge
- 14h 4m
- Merged PRs (30d)
- 4
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from Rdatatable/data.table
-
as.data.table() recurses without end on a survival::Surv object (or any data.frame carrying one) Open
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
Rdatatable/data.table#7887 ·
-
consistency tests
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Rdatatable/data.table#7853 · 3 comments ·
-
internals
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Rdatatable/data.table#6938 · 1 comment ·
-
encoding fread
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Rdatatable/data.table#5179 · 8 comments ·
-
documentation programming
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Rdatatable/data.table#3199 · 3 comments ·
All issues in Rdatatable/data.table
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
r-lib/pkgdepends#485 · 3 comments ·
-
Difficulty 1/5 Under an hour Newbie friendliness 92/100
-
beginners blocker
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enviPathR OpenBuild Error Build OK Build Warning policies-accepted pre-review precheck-passed
Difficulty 1/5 Under an hour Newbie friendliness 84/100
Bioconductor/BiocContributions#207 · 6 comments ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
datacarpentry/semester-biology#1255 ·