请问 Parameter server 架构下,训练策略是同步SGD还是异步SGD啊
Open
- Dominant language
- C++
- Stars
- 2.9k
- Forks
- 553
- PR merge metrics
- No merged PRs in 30d
Description
想分布式使用一下,看Euler采用的是Parameter Server,想问一下训练策略是同步SGD还是异步SGD啊,如果是异步SGD,对于梯度延迟有什么补偿机制吗?
感谢!
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, or entry point is identified. The issue asks whether Euler's Parameter Server uses synchronous or asynchronous SGD and whether delayed gradients are compensated, so the work would first require locating the relevant training documentation or implementation before defining what an answer should cover.
Written by the indexing model from the issue text.
Assessment
- Domain
- distributed-systems, machine-learning
- Issue type
- Documentation
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 10/100