bloomreach / bloomreach/s4cmd

Error: S4cmd : An error occurred (InvalidArgument) when calling the UploadPart operation: Part number must be an integer between 1 and 10000, inclusive

Open
#238 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1.4k
Forks
209
PR merge metrics
No merged PRs in 30d

Description

Hi,
I am trying to upload a 560 GB file to s3 bucket and it's failing with below error.

```
[Exception] An error occurred (InvalidArgument) when calling the UploadPart operation: Part number must be an integer between 1 and 10000, inclusive
Exception in thread Thread-13:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/local/bin/s4cmd.py", line 542, in run
fail('[Exception] ', exc_info=e)
File "/usr/local/bin/s4cmd.py", line 189, in fail
raise RuntimeError(status)
RuntimeError: 1

[Exception] An error occurred (InvalidArgument) when calling the UploadPart operation: Part number must be an integer between 1 and 10000, inclusive
Exception in thread Thread-17:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/local/bin/s4cmd.py", line 542, in run
fail('[Exception] ', exc_info=e)
File "/usr/local/bin/s4cmd.py", line 189, in fail
raise RuntimeError(status)
RuntimeError: 1
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading /usr/local/bin/s4cmd.py around line 542 and the failure handling at line 189, then trace how the UploadPart requests and part numbers are produced for a 560 GB file. Reproduce the multipart upload if possible and verify that it completes without AWS's InvalidArgument error.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cli, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.