alibaba / alibaba/euler

请问 Parameter server 架构下,训练策略是同步SGD还是异步SGD啊

Open
#225 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

想分布式使用一下,看Euler采用的是Parameter Server,想问一下训练策略是同步SGD还是异步SGD啊,如果是异步SGD,对于梯度延迟有什么补偿机制吗?
感谢!

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is identified. The issue asks whether Euler's Parameter Server uses synchronous or asynchronous SGD and whether delayed gradients are compensated, so the work would first require locating the relevant training documentation or implementation before defining what an answer should cover.

Written by the indexing model from the issue text.

Assessment

Domain
distributed-systems, machine-learning
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
10/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.