intel / intel/llm-scaler

minimax h3性能优化以及1080P的支持

Open
#585 0 comments 0 reactions 1 assignee Claimed by @xiangyuT View on GitHub
Dominant language
C++
Stars
529
Forks
80
Avg merge
9h 7m
Merged PRs (30d)
38

Description

1. 性能优化
2. 需要支持1080P,当前显存只用到30G左右就OOM了
xpu-smi dump -m 5,18,22
Timestamp, DeviceId, GPU Memory Utilization (%), GPU Memory Used (MiB), Compute Engine 0 (%)
13:59:40.921, 0, 94.29, 30791.52, 0.00

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.