AusClimateService / AusClimateService/model-evaluation
Memory issues with percentile calculation
Open
blocker
- Dominant language
- Jupyter Notebook
- Stars
- 1
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
When using xclim or icclim to calculate indices that involve calculating a threshold along the entire time axis (a percentile-based threshold), memory usage can explode for large multi-dimensional (i.e. high lat/lon resolution) arrays.
A solution to this problem (i.e. appropriate file chunking and/or use of dask) needs to be found before we can commit to using xclim or icclim for the calculation of climate indices.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.