galaxyproject / galaxyproject/galaxy

Optimize copying workdir tool outputs

Open
#4,657 0 comments 3 reactions 0 assignees View on GitHub
area/jobs area/performance kind/enhancement
Dominant language
Python
Stars
1.9k
Forks
1.2k
Avg merge
2d 16h
Merged PRs (30d)
169

Description

We discussed this over ~🍻~ soup last night - right now Galaxy just issues a ``cp`` command for these outputs and doesn't verify the ``cp`` worked. We should try to do a hardlink before copying and we should track whether this cp was successful or not.

Ping @natefoo - this is what we talked about right?

Contributor guide

Open the contributing guide

Research direction

Start by locating the Galaxy code that issues the cp command for workdir tool outputs and read the surrounding output-copy path. Verify how hardlinking can be attempted before copying and how the result of the copy is currently handled; done means both behaviors are implemented and covered by relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.