mapbox / mapbox/osm-wayback

Way Geometries

Open
#7 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Consider... just consider a different schema for a separate rocksdb that holds just node geometry. Perhaps skip the json conversion, and find a new way to store just non-tagged nodes. Ways would then also save their node refs and a third script could be written that performs this lookup in the secondary location db. Possible to have two open rocksdbs at the same time?

The actual stitching together of geometries and versions may then be done in a streaming process at a feature level, once the features were enriched with the node histories; keep it out of memory and do it in parallel :)

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by reviewing the existing RocksDB schema and the current geometry, node-reference, and streaming flows; determine whether the proposed separate database and parallel feature-level stitching fit the project. Done would require an agreed design and implementation plan, not just a localized edit.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.