allenai / allenai/tango

Beaker Executor should execute multiple Tango steps in one Beaker experiment

Ouverte
#457 3 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
feature request integration: beaker
Langage dominant
Python
Étoiles
572
Forks
55
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

### 🚀 The feature, motivation and pitch

Beaker experiments have significant overhead. When we're running many small Tango steps, we can save some time by running multiple steps at once.

An issue is that we don't know ahead of time how long a step will take, so we don't know which steps make sense to group together. When running like this, it would make sense for Beaker experiments to poll the workspace for new work. This would be a drastic change in how we execute things, and it would overlap with Beaker functionality in uncomfortable ways. This feature requires some careful thought.

### Alternatives

_No response_

### Additional context

_No response_

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.