dchaley / dchaley/deepcell-segmentation

Update benchmarking to include total time

Open
#345 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
9
Forks
2
PR merge metrics
No merged PRs in 30d

Description

The benchmarking data currently includes times for the phases within each step. (In Batch terms, these are the Task runnables.)

But we also want the total, end-to-end time: from when the user submits the job, to when it completes.

The gather-benchmark script doesn't have access to job completion; indeed the job isn't done yet (this script being a part of the job itself).

We need to add the start time to the preprocessing script, as well as the end time to the postprocessing script. This accounts for end-to-end of *runtime* but still doesn't include the upfront machine allocation + container fetch.

We also need to fetch the batch state changes (queued → scheduled → running) to get that data.

This may be complicated when there are multiple tasks running within a job (1 per input file).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.