GoogleCloudPlatform / GoogleCloudPlatform/gsutil

Unable to transfer a file from GCS to S3 bucket

Open
#943 4 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
918
Forks
335
PR merge metrics
No merged PRs in 30d

Description

We are trying to run the command to copy files from our GCS to our S3 bucket.

gsutil cp gs://bucketname/text.txt s3://bucketname/

But we keep getting this error from the S3 bucket in response

'HTTP/1.1 403 Forbidden\r\n'

We added the these configs to our .boto file

[s3]
calling_format = boto.s3.connection.OrdinaryCallingFormat
use-sigv4=True
host=s3.us-east-1.amazonaws.com
aws_access_key_id=key
aws_secret_access_key=secret key

We confirmed that the credentials are valid. I just wanted to ask are we missing something in our .boto configuration?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the gsutil cp gs://bucketname/text.txt s3://bucketname/ command with the supplied .boto S3 settings and inspect the resulting 403 response. Trace the CLI's S3 configuration and authentication handling to determine whether the settings are accepted. Done means identifying a reproducible configuration fix or documenting the missing information or limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, gcp, python
Domain
cli, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.