Decoder for MultiIndexes fails if there are other variables, using a dimension which is part of the multiindex
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 3/5
- Tempo stimato
- 1-2 giorni
- Idoneità per principianti
- 48/100
Direzione di ricerca
Start in cf_xarray/coding.py at decode_compress_to_multi_index and reproduce the example with var_with_lat added. Inspect the set_xindex call and confirm the fix by verifying that the encoded dataset decodes successfully when another variable uses a MultiIndex dimension.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
First, thank you so much. Compression-by-gathering is an incredibly usefull addition, which hopefully will end up in xarray for ragged (or sparse) array support on netcdf's. one day.
#321 added support encoding and decoding for Pandas multi-indexes using "compression by gathering". However if there are other variables in the dataset using a dimension which is part of the multiindex, decode fails.
Minimum example, is a single line addition of var_with_lat , derived from the Encoding and decoding tutorial:
ds = xr.Dataset(
{"landsoilt": ("landpoint", np.random.randn(4), {"foo": "bar"})},
{
"landpoint": pd.MultiIndex.from_product(
[["a", "b"], [1, 2]], names=("lat", "lon")
)
},
)
# ADDING THIS LINE WILL FAIL THE DECODING PROCESS.
# ds["var_with_lat"] = xr.DataArray([1,2], dims="lat")
encoded = cfxr.encode_multi_index_as_compress(ds, "landpoint")
decoded = cfxr.decode_compress_to_multi_index(encoded, "landpoint")
Once var_with_lat is added, decoding fails:
---> [129](file:///home/mirico/git/Curvefit/tests/scratch%20copy.py?line=128) decoded = cfxr.decode_compress_to_multi_index(encoded, "landpoint")
File [~/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py:116](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a2232302e37372e32382e323139222c2275736572223a226d697269636f227d.vscode-resource.vscode-cdn.net/home/mirico/git/~/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py:116), in decode_compress_to_multi_index(encoded, idxnames)
[110](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=109) from xarray.indexes import PandasMultiIndex
[112](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=111) variables = {
[113](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=112) dim: encoded[dim].isel({dim: xr.Variable(data=index, dims=idxname)})
[114](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=113) for dim, index in zip(names, indices)
[115](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=114) }
--> [116](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=115) decoded = decoded.assign_coords(variables).set_xindex(
[117](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=116) names, PandasMultiIndex
[118](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=117) )
[119](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=118) except ImportError:
[120](file:///home/mirico/devenv3/lib/python3.11/site-packages/cf_xarray/coding.py?line=119) arrays = [encoded[dim].data[index] for dim, index in zip(names, indices)]
File [~/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py:4330](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a2232302e37372e32382e323139222c2275736572223a226d697269636f227d.vscode-resource.vscode-cdn.net/home/mirico/git/~/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py:4330), in Dataset.set_xindex(self, coord_names, index_cls, **options)
[4327](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4326) indexed_coords = set(coord_names) & set(self._indexes)
[4329](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4328) if indexed_coords:
-> [4330](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4329) raise ValueError(
[4331](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4330) f"those coordinates already have an index: {indexed_coords}"
[4332](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4331) )
[4334](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4333) coord_vars = {name: self._variables[name] for name in coord_names}
[4336](file:///home/mirico/devenv3/lib/python3.11/site-packages/xarray/core/dataset.py?line=4335) index = index_cls.from_variables(coord_vars, options=options)
ValueError: those coordinates already have an index: {'lat'}
- Lingua principale
- Python
- Stelle
- 181
- Fork
- 49
- Merge medio
- 43m
- PR unite (30g)
- 1
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di xarray-contrib/cf-xarray
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
xarray-contrib/cf-xarray#623 ·
-
Consider adding opt-in support for circular axes when calling `bounds_to_vertices` (related to #594) Aperta
Difficoltà 5/5 Più di una settimana Idoneità per principianti 38/100
xarray-contrib/cf-xarray#596 · 1 commento ·
-
Difficoltà 3/5 1-2 giorni Idoneità per principianti 25/100
xarray-contrib/cf-xarray#570 ·
-
Difficoltà 4/5 3-5 giorni Idoneità per principianti 15/100
xarray-contrib/cf-xarray#568 ·
-
Difficoltà 3/5 1-2 giorni Idoneità per principianti 35/100
xarray-contrib/cf-xarray#566 · 2 commenti ·
Tutte le issue di xarray-contrib/cf-xarray
Issue simili
-
bug
Difficoltà 2/5 1-3 ore Idoneità per principianti 86/100
zostera/django-bootstrap4#894 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
use-agent-os/agent-os#3276 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 88/100
zephyrproject-rtos/zephyr#119726 ·
-
area/auth bug comp/agent P3 platform/discord type/security
Difficoltà 2/5 1-3 ore Idoneità per principianti 88/100
NousResearch/hermes-agent#117848 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
zilliztech/memsearch#759 ·