FedML-AI / FedML-AI/FedNLP

Could you support knowledge distillation-based FL algorithms like FedED, Fedmd, or FedDF

Open
#26 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
223
Forks
44
PR merge metrics
No merged PRs in 30d

Description

Currently, your platform supports some parameter-average-based FL algorithms. Could you support knowledge-distillation-based FL algorithms like FedED, Fedmd, or FedDF?

[FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction](https://aclanthology.org/2020.emnlp-main.165.pdf),
[Fedmd: Heterogenous federated learning via model distillation. NeurIPS workshop, 2019](https://arxiv.org/pdf/1910.03581.pdf )
FedDF, [Ensemble distillation for robust model fusion in federated learning. NeurIPS, 2020](https://arxiv.org/pdf/2006.07242.pdf)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.