google / google/fedjax

Feature request: Convert standard dataset into a federated dataset

Open
#206 5 comments 0 reactions 0 assignees View on GitHub
contributions welcome
Dominant language
Python
Stars
272
Forks
42
PR merge metrics
No merged PRs in 30d

Description

Synthetic federated datasets can constructed from standard centralized ones by artificially splitting them among clients. This is usually done using a Dirichlet distribution (e.g. [Hsu et al. 2019](https://arxiv.org/pdf/1909.06335.pdf)).
Such synthetic datasets are very useful since we can explicitly control the total number of users, as well as the heterogeneity.

It would be great to have primitives which can automatically convert standard numpy dataset into a FedJax datset.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.