developmentseed / developmentseed/tilebench

Issue 1

Open
#1 1 comment 0 reactions 0 assignees View on GitHub
issue-1
Dominant language
Python
Stars
41
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Internal block size for COG seems like an endless discussion.

Tilebench won't solve everything but with luck and nice reproducible process we will have a better understanding.

![](https://user-images.githubusercontent.com/10407788/82704233-1ce91280-9c43-11ea-8b97-85bf0cf8398b.png)

![](https://user-images.githubusercontent.com/10407788/82704321-486bfd00-9c43-11ea-9160-648a5bc02b8b.jpg)
Blue - internal blocks
Red - Mercator grid

### Methods
Input project has quite an effect so we should make sure to test with several projection

Tools:
- https://github.com/developmentseed/morecantile
- https://github.com/geospatial-jeff/async-cog-reader (compute internal blocks shapes)
- GDAL / Rasterio

### Expected results
- Timings (S3 latency and data transfer)
- Number of GET Called
- Transfered byte

### Dataset
- Sentinel 2 - Int16 1band
- Naip - 3 bands Byte

Ref:
https://github.com/opendatacube/benchmark-rio-s3/blob/master/report.md
https://github.com/vincentsarago/rio-tiler-bench
https://github.com/vincentsarago/gdal-http2-benchmark
https://github.com/vincentsarago/awspds-benchmark

Contributor guide

Open the contributing guide

Research direction

Start with Tilebench and the linked morecantile and async-cog-reader tools, then review the GDAL/Rasterio benchmarking references. Build a reproducible comparison across projections using Sentinel 2 and NAIP datasets; done means reporting S3 latency and transfer timings, GET request counts, and transferred bytes.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, data, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.