dandi / dandi/dandi-cli

Parallelize removal of extra files in Zarr

Open
#1,411 5 comments 0 reactions 0 assignees View on GitHub
performance UX zarr
Dominant language
Python
Stars
28
Forks
37
Avg merge
1d 17h
Merged PRs (30d)
9

Description

related
- #1410
describes the use-case. I think that removal is going very slow and primarily since we do it serially on groups of keys. Couldn't we parallelize (using the same jobs) and issue bunch of requests (with retries if needed) to that API DELETE endpoint?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.