DjangoPeng / DjangoPeng/LLM-quickstart
【AWQ_transformers.ipynb】下载facebook-opt-6.7模型到本地再加载报错
- Dominant language
- Jupyter Notebook
- Stars
- 1.1k
- Forks
- 590
- PR merge metrics
- No merged PRs in 30d
Description
### 作业: fine-tune-quickstart.ipynb
### **目标:**
因网络不稳定,打算把"facebook/opt-6.7b"模型下载到本地后再加载使用,进行量化。
### **代码如下:**
#下载模型

#加载模型

### **报错如下:**

**经查验本地存储内容为:**

完全和官网文件格式不一致,改为直接读取已经存在本地的缓存文件反而没有问题。
### **问题**
这是否说明:用transformers的from_pretrained方法从hf下载的原始模型到本地,用save_pretrained方法保存后,再用from_pretrained从本地指定路径读取这一方法是有使用限制的?
为什么会出现这样的问题?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with AWQ_transformers.ipynb and the referenced fine-tune-quickstart.ipynb, then compare the files produced by the local save with what the local from_pretrained call expects. Reproduce the error using the shown local path and determine whether the saved model format or loading arguments cause it. Done means explaining the limitation and documenting a reproducible local loading path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, jupyter-notebook, python
- Domain
- ai, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100