使用moss-moon-003-sft-int8量化模型后会报错 is not a folder containing a `.index.json`
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
整体文件上也查看了，确实是没有xxx.index.json文件。
https://huggingface.co/fnlp/moss-moon-003-sft-int8/tree/main
标准的未量化的。https://huggingface.co/fnlp/moss-moon-003-sft/tree/main内包含有index.json文件。
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by comparing the files in the quantized moss-moon-003-sft-int8 repository with the standard moss-moon-003-sft repository linked in the issue, focusing on the missing .index.json file and the reported loading error. Reproduce the failure with the quantized model and determine whether the model can load successfully or the repository needs a documented compatibility correction.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100