nextflow-io / nextflow-io/nextflow
`stageIn/OutMode = *` options
Open
Nobody has claimed this yet.
lang/processes
stale
- Dominant language
- Groovy
- Stars
- 3.5k
- Forks
- 811
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 61
Description
New feature
Hi,
Would you be able to add a new config option that let's us tweak the cp/rsync/rclone options during staging in/out
Use case
Speeding up transfers where possible, for example using better compression for rsync (--zc=zstd)
Suggested implementation
New config option which gets translated to the .command.run script
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how staging commands are generated into the .command.run script, focusing on the existing cp, rsync, and rclone paths. Determine how a new stageIn/OutMode option should pass tool-specific arguments, then verify that the generated script applies those options for staging in and out.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- groovy
- Domain
- devops
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100