any support plan for llava-llama3-70b/12b? any guide for Module optimization ?
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
1. **support plan**
when it will release the version for supporting llava-llama3-70b?
meainwhile, will it will consider of supporting unofficial version like, using llm of llama3-120b?
huggingface link: [mlabonne/Meta-Llama-3-120B-Instruct](https://huggingface.co/mlabonne/Meta-Llama-3-120B-Instruct)
2. **Module optimization**
i think it's very important to enhance the visual encoder funciton, so how can i change the visual encoder instead of just clip vit, suach as other clip or mamba visual version may be better?
or can i just add some personal adapter(just simple MLP may not be a good idea) for visual encoder and finetuning on my on datasets? looking farward to the guidline and hook methods.
i really to want to have a try on personal creativaty!
look forward to your reply, thx!
Contributor guide
Assessment
This issue has not been assessed yet.