OpenMOSS / OpenMOSS/MOSS-Audio

Inference可以支持Batch处理吗?以及finetune.py是否可以支持自定义system prompt

Open
#25 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
665
Forks
45
PR merge metrics
No merged PRs in 30d

Description

我看目前的infer.py是单样本处理的,可不可以考虑后续支持一下批量batch处理呢?
finetune.py目前写死了system id,可不可以考虑后续在数据集格式中加入system字段,然后可以自定义system?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading infer.py to understand its single-sample inference flow, then inspect finetune.py and the current dataset format. The work is done when inference accepts batches and fine-tuning can read a dataset system field instead of a fixed system prompt; no tests are named in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.