conda / conda/ceps

[Exploratory] Large data (and potentially other such things) as packages

Open
#64 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
34
Forks
41
Avg merge
1h 46m
Merged PRs (30d)
1

Description

Not sure if/how/what we'll formalize into CEP(s). But I'm starting to think about how we could use `conda` to deliver large data sets and other "non-code" binary blobs. Think reference genomes for `bioconda` packages, corpora for `nltk`, pre-trained models for `${your favorite new gen AI package}`, etc.

We can currently do things like just generating "huge" (multi-GB) packages or (ab)using post-link/activation scripts to run `wget some-suspect-url`, but I'm wondering if, as a community, we can come up with more clever solutions.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.