求出个量化版的推理示例
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
目前只用了量化版的脚本进行推理，但是不清楚怎么去设置联网 & 插件开关，直接用现有没经过量化的会报错， .index.json没找到
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by examining the existing quantized inference script mentioned in the issue and compare it with the failing unquantized invocation. Investigate how the internet and plugin switches are configured and why .index.json is missing. Done means a documented quantized inference example that explains these switches and avoids the reported error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100