Tensorflow Datasets Loading to GCS fails

Short description
TFDS is failing while loading dataset on GCS.
For smaller datasets like MNIST, there's no error and the code just runs fine. however for bigger datasets like "Coco2014", "imagenet" and "Open Images v4", the process stops, and gives the following error in the JSON Response.

Error: 500 Backend Error. Error Uploading to gs://bucket_name/path/to/store. Retrying Upload.

Environment information

• Operating System: Debian 9
• Python version: 3.6
• System Memory: 16 Gigs
• Free space in Secondary Storage: ~ 900 Gigs
• tensorflow-datasets/tfds-nightly version: tfds-nightly==1.0.2.dev201906200105
• tensorflow/tensorflow-gpu/tf-nightly/tf-nightly-gpu version: tensorflow==2.0.0b0

Reproduction instructions

import tensorflow_datasets as tfds
ds = tfds.load("open_images_v4", data_dir="gs://bucket/path") # Fails
ds = tfds.load("coco2014", data_dir="gs://bucket/path") # Fails
ds = tfds.load("imagenet", data_dir="gs://bucket/path") # Fails
ds = tfds.load("mnist", data_dir="gs://bucket/path") # Works fine

Logs

2019-07-05 03:26:19.998078: I tensorflow/core/platform/cloud/retrying_utils.cc:73] The operation failed and will be automatically retried in 0.35809 seconds (attempt 1 out of 10), caused by: Unavailable: Upload to gs://rickdey1998/data_dir/downloads/extracted/ZIP.images.cocodataset.org_zips_val2014_pvoFgUgScNHF-B32eNKpggUpVZ5-ATNBD48vuO5_eA.zip.incomplete_71bc721e170542848983123a225ba268/val2014/COCO_val2014_000000047149.jpg failed, caused by: Not found: Error executing an HTTP request: HTTP response code 410 with body '{

 "error": {

  "errors": [

   {

    "domain": "global",

    "reason": "backendError",

    "message": "Backend Error"

   }

  ],

  "code": 500,

  "message": "Backend Error"

 }

}

'

         when resuming upload gs://rickdey1998/data_dir/downloads/extracted/ZIP.images.cocodataset.org_zips_val2014_pvoFgUgScNHF-B32eNKpggUpVZ5-ATNBD48vuO5_eA.zip.incomplete_71bc721e170542848983123a225ba268/val2014/COCO_val2014_000000047149.jpg

Expected behavior
No error with larger datasets, and the dataset gets loaded on GCS, without any error, like any other smaller datasets.

Steps Already Taken

• Updated Tensorflow Datasets
• Contacted Cloud Support: They Said there's nothing wrong on their end.

CCs:
@vbardiovskyg @srjoglekar246

@rsepassi @Conchylicultor @cyfra

Start by reproducing the tfds.load calls for open_images_v4, coco2014, or imagenet with a GCS data_dir and compare them with MNIST. Trace the GCS upload and resume operation shown in the logs, especially the failing incomplete archive path. Done means larger datasets load to GCS without the backend error.