alibaba / alibaba/clusterdata

(v2026-spot-gpu): constant oversubscription of A10 GPUs

Open
#260 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.2k
Forks
482
PR merge metrics
No merged PRs in 30d

Description

regarding [cluster-trace-v2026-spot-gpu](https://github.com/alibaba/clusterdata/tree/master/cluster-trace-v2026-spot-gpu):

I want to use this dataset for trace-driven simulations, however I am encountering issues due to large amounts of pending workloads when using this trace. When analysing, I noticed that the demand for certain GPU types is higher then the available capacity in the cluster. The worst case is by far A10 GPUs which are drastically oversubscribed throughout the entire trace.

I calculated the oversubscription using `gpu * instances` occupation in `[arrival, arrival + duration)`. This causes more and more workloads to pile up in the queue which would only drain at the very end of the trace. The corresponding paper lists an allocation rate of `84.59%` for A10 GPUs, my calculations yield `133%` on average.

Could you please clarify how the allocation rate in the paper was calculated? Maybe I am missing something or was there some kind of preemption or failures which would have caused the workloads to not run their entire duration?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the cluster-trace-v2026-spot-gpu dataset and reproduce the reported A10 allocation rate using GPU, instances, arrival, and duration. Compare the calculation with the paper's methodology and determine whether preemption or failures explain the discrepancy; done means documenting a clear explanation for the 84.59% versus 133% results.

Written by the indexing model from the issue text.

Assessment

Domain
data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.