facebookresearch / facebookresearch/HighResCanopyHeight

global data in s3 bucket not a valid Cloud Optimized GeoTiff

Open
#7 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
365
Forks
66
PR merge metrics
No merged PRs in 30d

Description

Hey!
Firstly, thanks so much for releasing these data and the models - it's really interesting and exciting! I have a question regarding the file format for the global data on the s3 bucket at:
s3://dataforgood-fb-data/forests/v1/alsgedi_global_v6_float/chm/

It appears that the tif files are not valid Cloud Optimized Geotiffs - it would be amazing if valid COGS could be made available to improve the accessibility of these data.

example to verify COG status using [riocogeo](https://cogeotiff.github.io/rio-cogeo/) and gdalinfo:

```
export AWS_NO_SIGN_REQUEST=YES

path="/vsis3/dataforgood-fb-data/forests/v1/alsgedi_global_v6_float/chm/300001101.tif"

rio cogeo validate $path
gdalinfo $path
```
```
The following warnings were found:
- The file is greater than 512xH or 512xW, it is recommended to include internal overviews

The following errors were found:
- The file is greater than 512xH or 512xW, but is not tiled
/vsis3/dataforgood-fb-data/forests/v1/alsgedi_global_v6_float/chm/300001101.tif is NOT a valid cloud optimized GeoTIFF
Driver: GTiff/GeoTIFF
Files: /vsis3/dataforgood-fb-data/forests/v1/alsgedi_global_v6_float/chm/300001101.tif
Size is 65536, 65536
Coordinate System is:
PROJCRS["WGS 84 / Pseudo-Mercator",
BASEGEOGCRS["WGS 84",
ENSEMBLE["World Geodetic System 1984 ensemble",
MEMBER["World Geodetic System 1984 (Transit)"],
MEMBER["World Geodetic System 1984 (G730)"],
MEMBER["World Geodetic System 1984 (G873)"],
MEMBER["World Geodetic System 1984 (G1150)"],
MEMBER["World Geodetic System 1984 (G1674)"],
MEMBER["World Geodetic System 1984 (G1762)"],
MEMBER["World Geodetic System 1984 (G2139)"],
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]],
ENSEMBLEACCURACY[2.0]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
ID["EPSG",4326]],
CONVERSION["Popular Visualisation Pseudo-Mercator",
METHOD["Popular Visualisation Pseudo Mercator",
ID["EPSG",1024]],
PARAMETER["Latitude of natural origin",0,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8801]],
PARAMETER["Longitude of natural origin",0,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8802]],
PARAMETER["False easting",0,
LENGTHUNIT["metre",1],
ID["EPSG",8806]],
PARAMETER["False northing",0,
LENGTHUNIT["metre",1],
ID["EPSG",8807]]],
CS[Cartesian,2],
AXIS["easting (X)",east,
ORDER[1],
LENGTHUNIT["metre",1]],
AXIS["northing (Y)",north,
ORDER[2],
LENGTHUNIT["metre",1]],
USAGE[
SCOPE["Web mapping and visualisation."],
AREA["World between 85.06°S and 85.06°N."],
BBOX[-85.06,-180,85.06,180]],
ID["EPSG",3857]]
Data axis to CRS axis mapping: 1,2
Origin = (1017529.720532266306691,0.000000000000000)
Pixel Size = (1.194328566955877,-1.194328566955879)
Metadata:
AREA_OR_POINT=Area
UNITS=METERS
Image Structure Metadata:
COMPRESSION=DEFLATE
INTERLEAVE=BAND
PREDICTOR=2
Corner Coordinates:
Upper Left ( 1017529.721, 0.000) ( 9d 8'26.25"E, 0d 0' 0.01"N)
Lower Left ( 1017529.721, -78271.517) ( 9d 8'26.25"E, 0d42'11.19"S)
Upper Right ( 1095801.237, 0.000) ( 9d50'37.50"E, 0d 0' 0.01"N)
Lower Right ( 1095801.237, -78271.517) ( 9d50'37.50"E, 0d42'11.19"S)
Center ( 1056665.479, -39135.758) ( 9d29'31.87"E, 0d21' 5.62"S)
Band 1 Block=65536x1 Type=Byte, ColorInterp=Gray
```

And also I saw somewhere that an "image date" layer had been made available on earth engine, are there any plans to also include this layer in the s3 bucket?

Many thanks,
Hugh

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.