Pipeline should support long-read submissions end-to-end
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Nextflow
- Stars
- 18
- Forks
- 8
- PR merge metrics
- No merged PRs in 30d
Description
Description of feature
The pipeline almost supports long-read submissions but requires two small tweaks.
- Modify accepted filetype for raw read submission to allow base-called reads in either FastQ or BAM format for PacBio and ONT. The ENA docs also allows tar.gz submission of raw data files, but this might be discontinued in the future. This task also includes speaking to ENA to make sure the documentation is up to date.
- genome_uploader needs to accept single-contig genomes for long reads, as type chromosome. Complete and deploy the existing PR in the genome_uploader repo.
- Add required parameters to NF for this step to upload single-contig genomes.
- Test end-to-end submission of a LR sample. Raw read BAMs can be very heavy and time-consuming to upload, so this needs to fail and try again gracefully.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the raw-read filetype handling and the Nextflow parameters for the genome upload step. Review the existing genome_uploader PR and confirm the ENA submission requirements for PacBio and ONT formats. Done means single-contig long-read genomes and FastQ/BAM submissions work end to end, including graceful retry after heavy uploads.
Written by the indexing model from the issue text.
Assessment
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100