InternLM / InternLM/xtuner

any support plan for llava-llama3-70b/12b? any guide for Module optimization ?

Open
#689 2 comments 0 reactions 1 assignee Claimed by @hhaAndroid View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

1. **support plan**

when it will release the version for supporting llava-llama3-70b?

meainwhile, will it will consider of supporting unofficial version like, using llm of llama3-120b?
huggingface link: [mlabonne/Meta-Llama-3-120B-Instruct](https://huggingface.co/mlabonne/Meta-Llama-3-120B-Instruct)

2. **Module optimization**

i think it's very important to enhance the visual encoder funciton, so how can i change the visual encoder instead of just clip vit, suach as other clip or mamba visual version may be better?
or can i just add some personal adapter(just simple MLP may not be a good idea) for visual encoder and finetuning on my on datasets? looking farward to the guidline and hook methods.
i really to want to have a try on personal creativaty!

look forward to your reply, thx!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.