cms-dev / cms-dev/cms

Provide command for re-running submissions in debug mode

Aperta
#1,007 0 commenti 0 reazioni 1 assegnatario Vedi su GitHub

@lw ci sta già lavorando.

Dal 29/8/2018.

cli feature_request
Lingua principale
Python
Stelle
1k
Fork
412
Merge medio
6g 10h
PR unite (30g)
3

Descrizione

A requested feature is a new command line tool, say cmsReRunSubmission, that takes the ID of a submission (plus, possibly, a set of testcase IDs, or a regex), compiles and evaluates the submission on a worker (in the same conditions as would normally happen in a contest) but forcefully keeps the sandbox and doesn't store the result (so, in particular, it doesn't overwrite the score): instead it prints the results on the console where the command is run (say, score, time and memory consumption, and the paths to the sandboxes where the compilation/evaluation happened).

Some changes are needed for this:

  • Jobs needs to support a keep_sandbox flag that overrides the one in the configuration;
  • EvalutionService needs to provide an RPC endpoint where arbitrary JobGroups can be provided for insertion in the queue and worker pool.

Additionally a "local" mode could also be provided, that compiles and evaluates the submission locally on the machine where the script is run. This would change the conditions in which the operations run but would make it easier and faster to access the data.

Guida per i contributori

Apri la guida per i contributori

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.