intake / intake/intake-xarray

`to_dask()` not lazy when `simplecache::` in urlpath

Open
#73 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
76
Forks
36
PR merge metrics
No merged PRs in 30d

Description

when loading `to_dask` with caching as in https://github.com/pangeo-data/pangeo-datastore/issues/113, `fsspec.open_local` first loads the whole dataset and then opens the data in `xarray`, still with chunks but after having spend the time on downloading.

is there a way to circumvent this in `intake-xarray` or is this a consequence from `fsspec` caching that cannot be changed for `intake-xarray`?

it would be great to just do `to_dask()` without spending the time to download and only cache when `xarray` runs `compute`.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.