bloomreach / bloomreach/s4cmd

int size errors when uploading large file (8GB) on 32-bit machine (raspberry pi)

Open
#153 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1.4k
Forks
209
PR merge metrics
No merged PRs in 30d

Description

Error:

[Exception] Python int too large to convert to C long
[Thread Failure] Python int too large to convert to C long

Command line:
s4cmd put -c 4 /mnt/xfer/largefile s3://bucketarray/largefile

Platform: Debian on armv7l (Raspbian)
Software:

s4cmd=2.1.0+ds-1

Hypothesis: Some code somewhere is attempting to convert a large python into into a C 'long' which can vary in size between platforms. Probably needs to be a long long or something.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing `s4cmd put -c 4 /mnt/xfer/largefile s3://bucketarray/largefile` on the reported Debian armv7l/Raspbian platform and trace the upload path that raises the C long conversion error. Done means an 8GB upload completes successfully on a 32-bit machine without the reported exception.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.