treeverse / treeverse/dvc

dvc gc remove <datafile-or-dir>

Open
#4,218 13 comments 16 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

A: gc feature request p2-medium
Dominant language
Python
Stars
15.9k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

This has already been mentioned a few times in #2325 but wanted to draw attention again to this aspect specifically:

Since dvc pull and dvc fetch allow for granular selection of targets it would be very helpful to be able to use dvc gc to remove those same targets from cache once we are done with them. In my case specifically, I have a few semi-independent datasets I would rather avoid having to keep in cache at the same time, but would like to be able to switch between for different analyses (and occasionally have both in cache for specific tasks).

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the dvc gc command alongside dvc pull and dvc fetch, focusing on how each resolves targets and identifies cache entries. Done means gc can accept a data file or directory target and remove the corresponding cached data without requiring unrelated targets to be removed.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.