Imageomics / Imageomics/dataverse-access

Determine memory requirements for download

Open
#1 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2
Forks
1
PR merge metrics
No merged PRs in 30d

Description

The current download logic may be importing the entire file into memory here:

https://github.com/Imageomics/dataverse-access/blob/7a67502d5a2fc87e3902982dd42690fbbbde9cce/dv.py#L73-L74

Determine if there is a streaming approach to reduce requirements.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by inspecting the download logic in dv.py at lines 73-74 and determine whether the current operation loads the entire file into memory. Investigate whether the existing command-line download path supports streaming, then verify that the chosen approach reduces memory requirements without changing download behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, performance
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.