cellcanvas / cellcanvas/cellcanvas-prototype
add tooling to access and compute on large embeddings
Open
- Dominant language
- Python
- Stars
- 12
- Forks
- 5
- PR merge metrics
- No merged PRs in 30d
Description
In order to support larger-than-memory embeddings, we need some tooling for performant lazy loading. A few features/characteristics:
- [ ] should support most numpy style indexing
- [ ] should allow for simple queries (e.g., ball point)
- [ ] must support zarr both local and remote (e.g., S3)
Libraries for IO:
- TensorStore. this seems like it's the most flexible backend-wise
- xarray
- dask (@kephale noted some performace limitations with large numbers of chunks in the napari tiled rendering work)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.