dmlc / dmlc/ps-lite

[WIP] Simple Example of Async SGD

Open
#1 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
1.6k
Forks
540
PR merge metrics
No merged PRs in 30d

Description

Based on what we have discussed, I think it is of great interest to show the following snippet of code.
- Assume features are mapped consecutively(i.e. no Localizer is neede)
- Assume all the node take its own partition of the data(i.e. no scheduler is needed)

Write a simple async SGD that defines ServerHandle and Worker Logic and that is all you need to do. This will demonstrate the core functionality of ps-lite without getting distracted in the other optimizations. And I think the efficiency should be fine for the case we described.

In the long run, we will want to move some of the specific optimization module(Localizer, WorkLoadPool) to dmlc-core eventually to design a user friendly API for more users to use them

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.