InSAR / Water Mask license info metadata not populated

Open
#222 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
38/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
data

Research direction

Start with stage_watermask.py and trace how the LICENSE.txt fields are written into the water mask VRT. Then follow the STATIC and InSAR workflows that read water_mask_description and populate waterMaskSource and mask disclaimer metadata. Done means the relevant products contain the license description instead of "(NOT SPECIFIED)" and no longer omit the disclaimer or valid_min attributes.

Written by the indexing model from the issue text.

Description

Issue

Currently, the operational InSAR products are populating the Water Mask Source with "(NOT SPECIFIED)" and omitting the mask disclaimer. These should be populated with the license terms for the water mask in accordance with its input datasets' licenses.

These errors are noted in the details of Issue #219 and Issue #204 ; submitting this as a separate Issue to raise awareness. Here are the error messages, copied here for convenience (note that the path in these messages has been generalized for all relevant product types):

  • "Value is '(NOT SPECIFIED)', which is not valid for nominal NISAR data. Path: /science/LSAR/[RIFG|RUNW|GUNW|ROFF|GOFF]/metadata/processingInformation/inputs/waterMaskSource"
  • "Attributes found in XML but not HDF5: {'disclaimer', 'valid_min'} - Dataset /science/LSAR/[GUNW | GOFF]/grids/frequencyA/unwrappedInterferogram/mask"
Background

During the implementation of the STATIC layers workflow (which also uses the water mask), there arose several discussions by NISAR ADT regarding the correct process that the STATIC and InSAR SASs should use re: the water mask license. The full discussions and final resolution are documented in these links:

Resolution (copied from: https://github-fn.jpl.nasa.gov/isce-3/isce/issues/2164#issuecomment-24044 ) :

Similar to the decision for the DEM license (see https://github.com/isce-framework/isce3/issues/80#issuecomment-3166138150):

  • Static Layers and InSAR products will include a waterMaskSource dataset that includes the concatenated Short Description + Notes fields from teh water mask LICENSE.txt (see here: https://github-fn.jpl.nasa.gov/isce-3/isce/issues/2164#issuecomment-23800)
  • Static Layers & GUNW & GOFF product will also include an attribute called disclaimer on their mask layers that includes the same string.
  • stage_watermask.py will read these two strings from the LICENSE.txt file, concatenate them into a single string, and insert this string into the water mask VRT file as a metadata item called "water_mask_description". The Static Layers and InSAR workflows will read it directly from the VRT.

cc: @xhuang-jpl @jungkyoJung @hfattahi

Dominant language
Python
Stars
239
Forks
90
Avg merge
13d 1h
Merged PRs (30d)
5

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from isce-framework/isce3

All issues in isce-framework/isce3

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.