OpenMOSS / OpenMOSS/MOSS-TTS-Nano

两种方式调用时间长短问题

Open
#71 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
4.4k
Forks
554
PR merge metrics
No merged PRs in 30d

Description

python infer_onnx.py --prompt-audio-path assets/audio/zh_1.wav --text "这是测试文本。" 相比较于使用指令python app_onnx.py启动服务器,之后调用curl -X POST "http://127.0.0.1:18083/api/generate" -F "text=这是测试文本。" -F "demo_id=demo-1" 速度更快。理论上不太对吧,服务器形式的接口模型常驻内存应该更快才对

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running the commands for infer_onnx.py and app_onnx.py, timing equivalent requests with the provided audio and text. Read infer_onnx.py and app_onnx.py to compare initialization, model loading, and request handling. Done means the timing difference is reproduced, its cause is identified, and the relevant behavior is corrected or documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, performance
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.