microsoft / microsoft/LLMLingua
[Question]: How to use a manually downloaded model
Open
@iofu728 is already working on this.
Since Apr 1, 2024.
question
- Dominant language
- Python
- Stars
- 6.7k
- Forks
- 428
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 1
Description
Describe the issue
Due to slow network, LLMLingua failed to download the model from huggingface during running.
requests.exceptions.ReadTimeout: (ReadTimeoutError("HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Read timed out. (read timeout=10)"), '(Request ID: a664234f-7f09-4a97-966a-aafabde074a1)')
model-00001-of-00002.safetensors: 0%| | 0.00/9.98G [05:17<?, ?B/s]
Is it possible that I download the model manually in advance and LLMLinggua load the model from a local location?
If it's possible, how to to it?
Thanks in advance!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.