InternLM / InternLM/xtuner

llava-surgery.py for phi3_mini to get gguf

Open
#659 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

I followed the instruction and got to `./iter_39620_hf` and `./iter_39620_llava`. I tried to convert them to gguf using the instrution [here ](https://github.com/ggerganov/llama.cpp/blob/master/examples/llava/README.md) but got into issues that I've seen [here](https://huggingface.co/xtuner/llava-llama-3-8b-v1_1/discussions/3)

as I see the gguf files are released on HF, is there a plan to put the script you used on github?

Thanks.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.