vllm-project / vllm-project/aibrix

Converting BurstGPT workload to workload trace format

Open
#448 0 comments 0 reactions 0 assignees View on GitHub
area/benchmark area/cli kind/feature
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 20h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

Adding a workload generator that generate workload file based on BurstGPT workload trace format (e.g., csv file).

### Use Case

The generator should support converting BurstGPT traces to unified workload format, which later on consumed by AIBrix client to generate real-world workloads. [Link to workload.](https://github.com/HPMLL/BurstGPT/tree/main)

### Proposed Solution

Adding a generator that incorporates different adapter to convert trace files into LLM request workloads format. This issue tracks the converter of BurstGPT traces.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.