cioos-siooc / cioos-siooc/ocean-data-parser

handling remote access files inputs and outputs

Open
#50 3 comments 0 reactions 1 assignee Claimed by @JessyBarrette View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
5
Forks
2
PR merge metrics
No merged PRs in 30d

Description

In some deployments, the input files and/or the output folder are within remote servers. It would be great to be able to handle those type of deployments:

key aspect to handle
## inputs
- input connection parameters in config
- run glob on remote server
- hash files
## processing
- load a temporary file locally
- run parser on local temporary file or memory

## output

- output connection parameters in config
- upload file to output server

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.