nextflow-io / nextflow-io/nextflow
A flag to remove quotation marks from index file
Nobody has claimed this yet.
- Dominant language
- Groovy
- Stars
- 3.5k
- Forks
- 811
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 61
Description
New feature
Usage scenario
I want to create a several entry point for the pipeline, so that users would be able to rerun my pipeline from the middle. This requires a creation of file list which are required to run pipeline from middle entry point (see example).
Suggest implementation
For this I find index file creation a very useful feature. The only problem is that quotation marks are added to the values. This makes index files more difficult to read as well as prevents a direct reading from them with .splitCsv operator as quotation marks are still left. This causes an error:
ERROR ~ Error executing process > 'PYCISTOPIC:INFERPEAKS:InferConsensus (22)'
Caused by:
Not a valid path value: '"home/launchdir/results/narrowPeaks/neurons_peaks.narrowPeak"'
So it would be great to have a way to remove quotation marks from index file
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the index-file creation behavior described in the issue and compare it with the linked Nextflow index-files documentation; then trace how the resulting file is consumed by splitCsv. Done means an opt-in flag produces an index file without quotation marks and the generated file can be read without the quoted-path error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- groovy
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 54/100