GoogleCloudPlatform / GoogleCloudPlatform/gsutil

gsutil ls problems with ETag

Open
#1,192 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
918
Forks
335
PR merge metrics
No merged PRs in 30d

Description

gsutil version: 4.58

I have files that were uploaded in multipart mode. The result was "composite" files, which is not at all desirable. When I inspect the files using my normal client app (CloudBerry), I can see the component count `x-goog-component-count`, an unknown ETag, etc. When I replace this file with a normal upload, component count goes away, as expected and I can see an MD5 hash for the ETag.

However, when viewing the files with `gsutil ls -L` or `gsutil ls -le`, I see a different ETag that is wrong. This ETag only shows up with `gsutil`. Getting the header when I download the file shows the MD5 and my client app shows the MD5.

```
Composite version:

Creation time: Wed, 02 Dec 2020 15:19:42 GMT
Update time: Wed, 02 Dec 2020 15:19:42 GMT
Storage class: STANDARD
Content-Length: 383079357
Content-Type: application/x-rar-compressed
Component-Count: 12
Metadata:
goog-reserved-file-mtime:1525739036
Hash (crc32c): QhSwXA==
ETag: CMaExK7Mr+0CEAE=
Generation: 1606922382934598
Metageneration: 1
ACL: []

Regular version:

Creation time: Thu, 04 Feb 2021 03:36:20 GMT
Update time: Thu, 04 Feb 2021 03:36:20 GMT
Storage class: STANDARD
Content-Length: 383079357
Content-Type: application/octet-stream
Metadata:
cb-modifiedtime: Wed, 02 Dec 2020 15:19:42 GMT
Hash (crc32c): QhSwXA==
Hash (md5): qyumL5XBL/8z5pissaEQOQ==
ETag: CN+BucGmz+4CEAE=
Generation: 1612409780191455
Metageneration: 1
ACL: []
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.