linkedin / linkedin/Liger-Kernel

Why do not apply liger kernal to mlp in the ViT of Qwen2.5-VL?

Open
#805 4 comments 0 reactions 1 assignee Claimed by @Leon1207 View on GitHub
Dominant language
Python
Stars
6.6k
Forks
603
Avg merge
1d 20h
Merged PRs (30d)
47

Description

Image
Thanks for your work!
Here I found we do not apply liger kernal to mlp in the ViT of Qwen2.5-VL, what's your consideration? Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.