activeloopai / activeloopai/deeplake

[FEATURE] Tool to upload all image files to a hub store

未關閉
#1,173 1 則留言 0 個 reaction 已指派 1 人 已被 @anonymous-baaka 認領 在 GitHub 檢視
enhancement hacktoberfest
主要語言
C++
星號
9.2k
分支
722
PR 合併指標
30 天內沒有已合併 PR

描述

## 🚨🚨 Feature Request

- [ ] Related to an existing [Issue](../issues)
- [x] A new implementation (Improvement, Extension)

### If your feature will improve `HUB`

Create a tool that will recursively walk a given local directory and upload any image files found to the given hub-format store.

### Description of the possible solution

Suggested API:
```python
hub-upload-images --source-path # directory with image files
--labels-file # text file with a mapping of (base) filename to label
--hub-store-path # path to the hub-store
--sample-compression
[--extensions ] # optional. Default: jpg,jpeg,JPG,JPEG
[--verify|--no-verify] # set verify=True or False in hub.read(). Default=True
```
The labels-file could be a comma-separated file with entries like:
```python
filename1,0
filename2,1
filename3,0
```
Example invocations:
```python
# Upload all jpeg files with extension jpeg or JPEG to a local directory
$ hub-upload-images --source-path ./data/images --labels-file ./data/labels.txt --hub-store-path ./data/hub-store --extensions jpg,jpeg,JPG,JPEG

# Upload local-disk to s3
$ hub-upload-images --source-path ./data/images --labels-file ./data/labels.txt --hub-store-path s3://hub-datasets/myimages-set1 --extensions jpg,JPEG,png,PNG --sample-compression jpeg

# Upload local-disk to hub
$ hub-upload-images --source-path ./data/images --labels-file ./data/labels.txt --hub-store-path hub://mydatasets/myimage-set1 --sample-compression jpeg

# Upload s3 to s3
$ hub-upload-images --source-path s3://mydata/images-for-ml --labels-file ./data/labels.txt --hub-store-path hub://mydatasets/myimage-set1 --sample-compression jpeg
```

Notes:
If there is only one file extension, then the sample_compression can automatically by that.If there is only one file extension, then the sample_compression can automatically by that.

Difficulty: Hard

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。