nextflow-io / nextflow-io/nextflow

A flag to remove quotation marks from index file

Open
#5,546 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

good first issue stale
Dominant language
Groovy
Stars
3.5k
Forks
811
Avg merge
2d 11h
Merged PRs (30d)
61

Description

New feature

Usage scenario

I want to create a several entry point for the pipeline, so that users would be able to rerun my pipeline from the middle. This requires a creation of file list which are required to run pipeline from middle entry point (see example).

Suggest implementation

For this I find index file creation a very useful feature. The only problem is that quotation marks are added to the values. This makes index files more difficult to read as well as prevents a direct reading from them with .splitCsv operator as quotation marks are still left. This causes an error:

ERROR ~ Error executing process > 'PYCISTOPIC:INFERPEAKS:InferConsensus (22)'
Caused by:
  Not a valid path value: '"home/launchdir/results/narrowPeaks/neurons_peaks.narrowPeak"'

So it would be great to have a way to remove quotation marks from index file

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the index-file creation behavior described in the issue and compare it with the linked Nextflow index-files documentation; then trace how the resulting file is consumed by splitCsv. Done means an opt-in flag produces an index file without quotation marks and the generated file can be read without the quoted-path error.

Written by the indexing model from the issue text.

Assessment

Tech stack
groovy
Domain
data-engineering
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
54/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.