rs extract: implement generic feature validation in base handler
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.1k
- Forks
- 385
- PR merge metrics
- No merged PRs in 30d
Description
At the moment the `rs extract` handlers are responsible to walk over OpenStreetMap and collect and extract GeoJSON features for the training dataset. Every handler has to start from scratch with OpenStreetMap data validation e.g. making sure polygons are closed ways, or that ways have more than a single node \*.
We should write a base handler which already provides reasonable guarantees for the input data to work on.
This base handler could also provide functionality to batch-write features; see https://github.com/mapbox/robosat/issues/120.
_* Which is not always the case, e.g. see https://www.openstreetmap.org/way/5699705_
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the `rs extract` handlers and reading how each validates OpenStreetMap data before collecting GeoJSON features. Review issue #120 for the proposed batch-writing scope; done should mean shared validation is provided by a base handler and handlers no longer duplicate those guarantees.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100