ByteDance-Seed / ByteDance-Seed/decoupleQ
量化好几个小时候出现报错,网络问题:ConnectionError
- Dominant language
- Cuda
- Stars
- 153
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
time cost for block minimization: 98.45541977882385
quant layer 31 done! time cost 295.21963691711426
The quantization duration is 2.6511569974819817
Traceback (most recent call last):
File "/workspace/decoupleQ/copy_llama.py", line 427, in
dataloader, testloader = get_loaders(
File "/workspace/decoupleQ/datautils.py", line 209, in get_loaders
return get_ptb_new(nsamples, seed, seqlen, model)
File "/workspace/decoupleQ/datautils.py", line 140, in get_ptb_new
traindata = load_dataset('ptb_text_only', 'penn_treebank', split='train')
File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1657, in load_dataset
builder_instance = load_dataset_builder(
File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1494, in load_dataset_builder
dataset_module = dataset_module_factory(
File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1204, in dataset_module_factory
raise e1 from None
File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1148, in dataset_module_factory
).get_module()
File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 523, in get_module
local_path = self.download_loading_script(revision)
File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 506, in download_loading_script
return cached_path(file_path, download_config=self.download_config)
File "/opt/conda/lib/python3.10/site-packages/datasets/utils/file_utils.py", line 298, in cached_path
output_path = get_from_cache(
**File "/opt/conda/lib/python3.10/site-packages/datasets/utils/file_utils.py", line 615, in get_from_cache
raise ConnectionError(f"Couldn't reach {url} ({repr(head_error)})")
ConnectionError: Couldn't reach https://raw.githubusercontent.com/huggingface/datasets/1.17.0/datasets/ptb_text_only/ptb_text_only.py (ReadTimeout(ReadTimeoutError("HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Read timed out. (read timeout=10)")))**
**1:想知道网络问题如何解决
2. 不知道可不可以把量化和这个访问网络的过程分开?解耦下,不然一整个流程的一个小bug,前面的半天的量化就白跑了**
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at copy_llama.py line 427 and trace get_loaders in datautils.py to get_ptb_new at line 140, where datasets.load_dataset fetches PTB. Reproduce the timeout if possible, then inspect how quantization and evaluation data loading are sequenced. Done means the network failure is handled without losing completed quantization work, with the affected workflow verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- data, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100