dmlc / dmlc/dmlc-core

Support for Google Cloud Storage

Open
#14 3 comments 0 reactions 0 assignees View on GitHub
call for contribution
Dominant language
C++
Stars
878
Forks
526
Avg merge
12d 19h
Merged PRs (30d)
1

Description

Support for google cloud storage can be done similarly as https://github.com/dmlc/dmlc-core/blob/master/src/io/s3_filesys.cc via rest API

It could involve a refactor of s3 filesys to be a general base, which take s3 and gcs as child class. Guess similar thing could also be done to support Azure's cloud.

Anyone who is interested in claim this is welcomed to reply on this thread

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading src/io/s3_filesys.cc, which the issue identifies as the model for this work. Trace how its REST API access and filesystem abstraction are organized, then determine the scope of adding Google Cloud Storage and any shared S3/GCS base; done means GCS storage is supported through the requested API.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, google-cloud
Domain
cloud
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.