linkedin / linkedin/Liger-Kernel
CI failure tracker
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6.6k
- Forks
- 603
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 47
Description
### 🐛 Describe the bug
Most failures are related to transformers VLM changes
## unit test
qwen2vl_mrope
- [x] test_qwen2vl_mrope https://github.com/linkedin/Liger-Kernel/pull/728
monkey patch
- [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_mllama_for_conditional_generation https://github.com/linkedin/Liger-Kernel/pull/737
- [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_gemma3 https://github.com/linkedin/Liger-Kernel/pull/735
- [ ] test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_vl https://github.com/linkedin/Liger-Kernel/pull/738 https://github.com/linkedin/Liger-Kernel/pull/755
- [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_5_vl https://github.com/linkedin/Liger-Kernel/pull/738 https://github.com/linkedin/Liger-Kernel/pull/755
## convergence test
VLM changes related #723 (config, video_processor, ...)
- [x] llava https://github.com/linkedin/Liger-Kernel/pull/743
- [x] qwen2_vl https://github.com/linkedin/Liger-Kernel/pull/738
- [x] qwen2_5_vl https://github.com/linkedin/Liger-Kernel/pull/738
- [x] gemma3 https://github.com/linkedin/Liger-Kernel/pull/735
_init_weights related (#739)
- [x] olmo2 https://github.com/linkedin/Liger-Kernel/pull/741
- [x] glm4 https://github.com/linkedin/Liger-Kernel/pull/741
- [x] gemma1 https://github.com/linkedin/Liger-Kernel/pull/741
- [x] gemma2 https://github.com/linkedin/Liger-Kernel/pull/741
logits numerical issue (#742)
- [ ] gemma3
- [ ] gemma
- [ ] paligemma
- [ ] paligemma2
### Reproduce
_No response_
### Versions
liger_kernel==https://github.com/linkedin/Liger-Kernel/commit/5d25e46827cd63210373d7a15641438b0bf36c66
trasnformers==4.52.3
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the listed unit tests, especially test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_vl, and the convergence checks for Gemma3, Gemma, PaliGemma, and PaliGemma2. Review the referenced pull requests and run the remaining failing CI tests against liger_kernel commit 5d25e468 and transformers 4.52.3. Done means the unchecked failures are resolved or clearly tracked with updated test results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100