open_mfdataset concat_dim chunk
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.2k
- Forks
- 1.4k
- Avg merge
- 2d 15h
- Merged PRs (30d)
- 14
Description
open_mfdataset does not allow chunking along concat_dim.
As a result if specific chunking is sought along that dimension by the user it may be best not to pass chunks at the open_mfdataset stage and rechunk variables afterwards.
This would be the case for example if chunks are large across files but small within files:
https://github.com/apatlpo/lops-array/blob/master/sandbox/natl60_tseries_debug.ipynb
I believe this is difficult to anticipate for new users (like me).
Couldn't this be specified in the documentation of open_mfdataset?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the open_mfdataset documentation and review the linked natl60_tseries_debug.ipynb example for the chunking scenario described. Document that chunking along concat_dim is not supported at this stage, explain when users should rechunk variables afterward, and verify the rendered documentation clearly reflects the behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 62/100