dandi / dandi/dandi-archive

zarr_content_read: include sizes for the "files" (and possibly "directories")

Open
#925 8 comments 0 reactions 0 assignees View on GitHub
released
Dominant language
Python
Stars
26
Forks
21
Avg merge
5d 6h
Merged PRs (30d)
14

Description

motivation: https://github.com/dandi/dandi-cli/pull/923#issuecomment-1050296836 -- in dandi-cli, to possibly avoid relatively expensive checksumming of the content to decide either a (changed) file within zarr needs to be reuploaded, we first check the size(s) of the file. If that one changed -- we know that we need to reupload even without computing its checksum.

It would be helpful if that API endpoint also returned sizes of the files (if it can do it without extra runtime penalty)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the zarr_content_read API endpoint and its existing response tests, then inspect how it obtains Zarr file metadata and whether size lookup adds runtime cost. Done means the endpoint returns file sizes and, if supported without extra penalty, directory sizes so dandi-cli can compare content before checksumming.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, backend
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.