vllm-project / vllm-project/aibrix
Converting Azure inference trace to workload trace format
Open
area/benchmark
area/cli
kind/feature
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
Adding a workload generator that generate workload file based on [Azure inference trace](https://github.com/Azure/AzurePublicDataset/tree/master/data) workload trace format (e.g., csv file).
### Use Case
The generator should support converting Azure inference traces to unified workload format, which later on consumed by AIBrix client to generate real-world workloads.
### Proposed Solution
Adding a generator that incorporates different adapter to convert trace files into LLM request workloads format. This issue tracks the converter of Azure inference traces.
Contributor guide
Assessment
This issue has not been assessed yet.