ipfs / ipfs/kubo

"ipfs add" calculate CID and check for it *before* uploading to API server.

Open
#7,586 13 comments 0 reactions 0 assignees View on GitHub
effort/weeks exp/expert kind/enhancement P3 topic/perf
Dominant language
Go
Stars
17.1k
Forks
3.2k
Avg merge
3d 18h
Merged PRs (30d)
11

Description

ipfs add should calculate the CID and check for it's existence on the api server / network *before* copying the data over.

An example scenario:

* I rsync 67GiB worth of files to my system
* I ```ipfs --api=$IPFS_API_SERVER add -r /cache/*``` to make them available.

In the above scenario, my remote ipfs client seemingly needs to upload 67.88GiB of files to the API server every time I sync to IPFS. Ideally the local ipfs binary could quickly generate a CID and check for the CID's existance *before* transferring the data to the remote API server. Even in local deployments this could save time since IPFS unnecessarily transferring files.

![ipfs](https://user-images.githubusercontent.com/100110/89739346-8956ff00-da45-11ea-89bf-1b92bf7c84de.png)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.