OpenMOSS / OpenMOSS/MOSS

微调后导出67g的bin文件,之后怎么做呢

Open
#327 17 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
12.3k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

我把原生模型下面的config.json等全都拷贝到新生成的bin文件同目录下了,将pytorch_model.bin.index 将所有的模型名称改成了pytorch_model.bin,启动moss_inferrance.py报错TypeError: expected str, bytes or os.PathLike object, not NoneType
请问有人成功吧微调后的模型部署推理了吗?应该如何做呢?另,求一个官方微信群的邀请~

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with moss_inferrance.py and reproduce the reported TypeError using the fine-tuned directory. Compare the copied config.json and pytorch_model.bin.index entries with the generated .bin file, then verify the expected model path and run inference. Done means the fine-tuned model loads and produces an inference result without the NoneType error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.