developmentseed / developmentseed/deck.gl-raster

Pixel discarding for f32 should use float next after for precision issues

Open
#160 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
228
Forks
29
Avg merge
12h 27m
Merged PRs (30d)
4

Description

If the nodata value is defined as a float64, then we need to consider precision issues because the GPU only supports float32.

We should be able to vendor https://github.com/scijs/nextafter/blob/master/nextafter.js. Then for filtering we may need to filter inside a range of `nextAfter(val, -Infinity), nextAfter(val, Infinity)`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the referenced nextafter.js implementation and trace the pixel filtering path that compares float32 GPU values with float64 nodata values. The work is done when the next-after bounds are used for filtering around the nodata value and precision-related pixel discarding is covered.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
computer-graphics, data-visualization
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.