alibaba / alibaba/euler

关于数据分片的问题

Open
#11 17 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

请问数据分片在hdfs储存中如何体现?在已有hdfs的情况下,分片的意义是什么?

以及tf_euler.initialize_shared_graph是否可以认为是同时启动了一个图引擎(service)和一个worker?

谢谢!

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue asks conceptual questions about data sharding in HDFS and the tf_euler.initialize_shared_graph entry point, but names no files or tests. Start by locating documentation and the implementation or usage of that entry point; done means documenting clear answers about HDFS storage, sharding, and the graph engine and worker roles.

Written by the indexing model from the issue text.

Assessment

Tech stack
tensorflow
Domain
distributed-systems, documentation
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.