InternLM / InternLM/InternEvo

[Feature] Add Lingen - MATE architecture (SSM Mamba2 based) as a model option

Open
#402 2 comments 0 reactions 1 assignee Claimed by @yhcc View on GitHub
enhancement
Dominant language
Python
Stars
421
Forks
67
PR merge metrics
No merged PRs in 30d

Description

### Describe the feature

LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation
with Linear Computational Complexity
https://arxiv.org/pdf/2412.09856

LinGen is non-transformer based SSM Mamba2 based model. We are working with the first author to implement this LinGen MATE architecture for video generation. We like to add LinGen MATE architecture as a model option to InternLM EVO. We would like to discuss with internlm EVO team about this implementation

### Will you implement it?

- [X] I would like to implement this feature and create a PR!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.