allenai / allenai/cached_path

Make installing for filetransfer scheme optional

Open
#201 2 comments 0 reactions 0 assignees View on GitHub
Feature request
Dominant language
Python
Stars
47
Forks
22
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
I only need files from S3-Buckets and I don't want to install dependencies which handle file-transfers with e.g. google drive.

**Describe the solution you'd like**
To learn how poetry enables this, please refer to [this link](https://python-poetry.org/docs/pyproject/). In essence, each subgroup must be specified under dependencies in the pyproject.toml file. I suggest considering the following groups: `s3`, `gc`, `hf`, `beaker`, and full (which installs all subgroups). Additionally, it’s important to consider a more user-friendly error message if the imported package is not installed. You can use importlib or a try-catch approach to achieve this.

**Describe alternatives you've considered**
The only alternative i considerd is using a packaged for each file-transfer scheme .

**Additional context**
-

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.