alibaba / alibaba/FederatedScope
A discussion about the efficiency of monitor
- Dominant language
- Python
- Stars
- 1.5k
- Forks
- 261
- PR merge metrics
- No merged PRs in 30d
Description
https://github.com/alibaba/FederatedScope/blob/b716a8c55ef3707aeeeef989d1112c8c1c60e167/federatedscope/core/monitors/monitor.py#L266
Will repeatedly opening a file deteriorate the efficiency?
As a vanilla python file stream (v.s. tf SummaryWriter), is it possible to cache the logs without blocking the main thread?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with federatedscope/core/monitors/monitor.py at line 266 and inspect how the monitor currently writes its logs. Compare the repeated file-opening behavior with TensorFlow SummaryWriter, then determine the measurable efficiency and non-blocking requirements; done should include an agreed caching or asynchronous logging design and evidence that it avoids blocking the main thread.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- observability-sre
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100