aai-institute / aai-institute/pyDVL
Implement scheduling algorithm
- Langage dominant
- Python
- Étoiles
- 146
- Forks
- 10
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
It makes sense to implement a heuristic for determining: How much processes to start (bookkeeping and data copying has computation cost) and also how much computation each one should perform.
Following three problems:
- Choose a `batch_size` converted to `computation_budget` or something similar.
- Speed changes within permutation sampling as well as the effective dataset gets smaller.
- For some subsets utility evaluations take longer than for others.
**Ideas**:
1. Use `N` processes to estimate `T(cb^(t)+d)`with `d ~ N(0, s=0.1)`, perform gradient descent to obtain `cb^(t+1)` next estimate.
2. Implement a policy via PPO or [Contextual Bandits](https://proceedings.neurips.cc/paper/2020/file/033cc385728c51d97360020ed57776f0-Paper.pdf). Later assumes that the position is not part of the state, e.g. the action `cb^(t)` is an absolute value and not the delta to the next value (which would be probably more stationary).
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.