InternLM / InternLM/xtuner

整合Liger Kernel: 最高效的Triton Training Kernels

Open
#919 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

Liger Kernel 已經廣泛整合進 SFTTrainer, Axolotl, Llama Factory, Hugging Face Trainer, 能有效降低 Memory 60%, 提速 20%.

https://github.com/linkedin/Liger-Kernel

我是原作者, 歡迎直接聯繫, wechat: wxid_nn8pbmlh9ae712

image

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.