DjangoPeng / DjangoPeng/LLM-quickstart
AWQ和BitsAndBytes量化是否需要数据去进行量化？
Open
- Dominant language
- Jupyter Notebook
- Stars
- 1.1k
- Forks
- 590
- PR merge metrics
- No merged PRs in 30d
Description
如题。从代码上看是不需要的？
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, or entry point is named. Start by reviewing the repository's AWQ and BitsAndBytes usage and their quantization documentation to determine whether calibration data is required; done would be a documented, repository-specific answer that resolves the question.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100