aai-institute / aai-institute/pyDVL

Implement scheduling algorithm

Ouverte
#449 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
146
Forks
10
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

It makes sense to implement a heuristic for determining: How much processes to start (bookkeeping and data copying has computation cost) and also how much computation each one should perform.

Following three problems:
- Choose a `batch_size` converted to `computation_budget` or something similar.
- Speed changes within permutation sampling as well as the effective dataset gets smaller.
- For some subsets utility evaluations take longer than for others.

**Ideas**:
1. Use `N` processes to estimate `T(cb^(t)+d)`with `d ~ N(0, s=0.1)`, perform gradient descent to obtain `cb^(t+1)` next estimate.
2. Implement a policy via PPO or [Contextual Bandits](https://proceedings.neurips.cc/paper/2020/file/033cc385728c51d97360020ed57776f0-Paper.pdf). Later assumes that the position is not part of the state, e.g. the action `cb^(t)` is an absolute value and not the delta to the next value (which would be probably more stationary).

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.