developmentseed / developmentseed/pixelverse

Client-side visualization of embeddings

Open
#27 2 comments 0 reactions 0 assignees View on GitHub
enhancement help wanted
Dominant language
Jupyter Notebook
Stars
32
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Placeholder ticket to track adding visualization tools for embeddings (either pre-generated like AlphaEarth or generated on-the-fly like Tessera/OlmoEarth).

We could go down a few paths depending on the embedding storage format + visualization library:

| Combinations | Storage format uptake | Visualization notes |
|--|--|--|
|GeoParquet + Lonboard |Format proposed at [cloudnativegeo/geo-embeddings-survey](https://github.com/cloudnativegeo/geo-embeddings-survey?tab=readme-ov-file#survey-for-current-practices-storing-embeddings-in-geoparquet), used initially in Clay v0 [see schema](https://clay-foundation.github.io/model/clay-v0/model_embeddings.html#table-schema) and EarthIndex | Lonboard is fairly mature, but does it support visualization based on FixedShapeTensorArray? |
| GeoTIFF/Zarr + [deck.gl-raster](https://github.com/developmentseed/deck.gl-raster) | [GeoTessera](https://github.com/ucam-eo/geotessera/tree/v0.7.3?tab=readme-ov-file#download-embeddings) supports GeoTIFF and [Zarr (since v0.7.1)](https://github.com/ucam-eo/geotessera/releases/tag/v0.7.1); OlmoEarth supports [GeoTIFF export](https://github.com/allenai/rslearn/blob/v0.0.20/docs/examples/OlmoEarthEmbeddings.md#compute-and-save-embeddings); AlphaEarth is in [COG](https://source.coop/tge-labs/aef) | GeoTIFF/COG viz is usable in deck.gl-raster, Zarr would need some work - https://github.com/developmentseed/deck.gl-raster/issues/166 |

To be worked on during DevSeed's annual gathering end of Feb 2026 at a workshop.
- Core goal: Visualize COGs only, just the first three bands in the embedding array for each pixel
- Stretch goal: Visualize Zarr (!), and/or do some dimensionality reduction (e.g. PCA, UMAP, etc) and then render as RGB

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.