Imageomics / Imageomics/cautious-robot

Verify file size

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
5
Forks
1
PR merge metrics
No merged PRs in 30d

Description

> When the input CSV doesn't have a checksum column we might fail to download the entire file without notifying the user. Could you check the [response headers](https://requests.readthedocs.io/en/latest/user/quickstart/#response-headers) for
[Content-Length](https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Content-Length) and compare that value to the size of the full size image file? Often web servers will set this response header so it would be nice to check it when this value is sent in the response.

_Originally posted by @johnbradley in https://github.com/Imageomics/cautious-robot/pull/8#discussion_r1631663496_

See also discussion following.

Contributor guide

No contributing guide indexed for this repository

Research direction

Trace the Python download and verification path for CSV-sourced full-size images, starting with where response headers and checksum handling are processed. Compare Content-Length with the downloaded file size when the header is present, and verify that incomplete downloads notify the user without breaking cases where the header is absent.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.