blaze / blaze/odo

Missing routes for Remote-Remote

Open
#100 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
131
PR merge metrics
No merged PRs in 30d

Description

We lack direct routes to copy data between remote computers without touching the local system.

``` Python
into('ssh://A:myfile.csv', 'ssh://A:myfile2.csv') # Should be a remote local copy
into('ssh://A:myfile.csv', 'ssh://B:myfile.csv') # Should result in a remote call to scp
into('hdfs://A:myfile.csv', 'ssh://A.myfile.csv') # Should result in hadoop fs calls
into('ssh://A:myfile.csv', 'hdfs://A.myfile.csv') # Should result in hadoop fs calls
...
```

When interacting with AWS the inter-node bandwidth is very high. It'd be nice to leverage this instead of pulling down and pushing up from local.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.