GoogleCloudPlatform / GoogleCloudPlatform/gsutil

gsutil with parallel_composite_upload repeatedly fails

Open
#203 4 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
918
Forks
335
PR merge metrics
No merged PRs in 30d

Description

This is on gsutil version 4.0

Running gsutil cp file://file gs://bucket on a 30gb file repeatedly fails: Some errors were:

PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
[Errno 104] Connection reset by peer
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
[Errno 104] Connection reset by peer
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
PreconditionException: 412 Precondition Failed
CommandException: Some temporary components were not uploaded successfully. Please retry this upload.

I ran it about 10 times; it never successfully completed.

Running the same command with parallel_composite_upload_threshold = 0 in ~/.boto consistently works.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.