activeloopai / activeloopai/deeplake

[FEATURE] Tool to upload all image files to a hub store

オープン
#1,173 コメント 1 件 リアクション 0 件 担当者 1 名 @anonymous-baaka が担当を希望しています GitHub で見る
enhancement hacktoberfest
主要言語
C++
スター
9.2k
フォーク
722
PR マージ指標
30日以内にマージされた PR はありません

説明

## 🚨🚨 Feature Request

- [ ] Related to an existing [Issue](../issues)
- [x] A new implementation (Improvement, Extension)

### If your feature will improve `HUB`

Create a tool that will recursively walk a given local directory and upload any image files found to the given hub-format store.

### Description of the possible solution

Suggested API:
```python
hub-upload-images --source-path # directory with image files
--labels-file # text file with a mapping of (base) filename to label
--hub-store-path # path to the hub-store
--sample-compression
[--extensions ] # optional. Default: jpg,jpeg,JPG,JPEG
[--verify|--no-verify] # set verify=True or False in hub.read(). Default=True
```
The labels-file could be a comma-separated file with entries like:
```python
filename1,0
filename2,1
filename3,0
```
Example invocations:
```python
# Upload all jpeg files with extension jpeg or JPEG to a local directory
$ hub-upload-images --source-path ./data/images --labels-file ./data/labels.txt --hub-store-path ./data/hub-store --extensions jpg,jpeg,JPG,JPEG

# Upload local-disk to s3
$ hub-upload-images --source-path ./data/images --labels-file ./data/labels.txt --hub-store-path s3://hub-datasets/myimages-set1 --extensions jpg,JPEG,png,PNG --sample-compression jpeg

# Upload local-disk to hub
$ hub-upload-images --source-path ./data/images --labels-file ./data/labels.txt --hub-store-path hub://mydatasets/myimage-set1 --sample-compression jpeg

# Upload s3 to s3
$ hub-upload-images --source-path s3://mydata/images-for-ml --labels-file ./data/labels.txt --hub-store-path hub://mydatasets/myimage-set1 --sample-compression jpeg
```

Notes:
If there is only one file extension, then the sample_compression can automatically by that.If there is only one file extension, then the sample_compression can automatically by that.

Difficulty: Hard

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。