azavea / azavea/osmesa

Possible timeout issue in StreamingFacetedEditHistogramTileUpdater

Open
#216 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
81
Forks
26
PR merge metrics
No merged PRs in 30d

Description

Observed this warning in the logs for the faceted tile generator:

```
21/04/21 19:24:38 WARN updater.package: Could not write s3://nome-osmesa/faceted-edit-tiles/v1/10/625/513.mvt: Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed. (Service: Amazon S3; Status Code: 400; Error Code: RequestTimeout; Request ID: 705CWB3Q4Z82F5SX; S3 Extended Request ID: XUGgyn5QFAx+gvJW8nox59SvXSypqYV/IwnIU9qmmdbc8TCmPH42wgRZCsoneVE1UfXoLeJ/qbI=)
```

This may perhaps be an indication of why this process gets stopped on a fairly regular basis. Look into this.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names StreamingFacetedEditHistogramTileUpdater and an Amazon S3 write warning; start by locating that updater and tracing the write that produced the logged RequestTimeout. Done means the timeout's relation to the process stopping is established and the issue records a verified fix or a documented finding.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, scala
Domain
cloud, data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.