kvcache-ai / kvcache-ai/ktransformers

[Bug] 无法正确识别模型文件

Open
#2,100 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.5k
Forks
1.6k
Avg merge
19h 32m
Merged PRs (30d)
27

Description

### Reminder

- [x] I have read the above rules and searched the existing issues.

### System Info

Ubuntu 24.04
KTransformers 0.6.3(在系统盘上)
Deepseek-V4-Flash(在另一个物理固态硬盘上)

### Reproduction

```
(/home/deepseeker/桌面/Deepseek_kt6/python) deepseeker@Fishbowl:/media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F$ kt model verify Deepseek-V4-Flash

⚠ HuggingFace Connection Failed

Cannot connect to https://huggingface.co

Auto-switching to HuggingFace mirror: hf-mirror.com

ℹ Verifying: Deepseek-V4-Flash
Repository: huggingface:deepseek-ai/deepseek-v4-flash
Local path: /media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F

✓ Fetched 62 file hashes from remote

Using 16 parallel workers for SHA256 calculation
✓ Calculated 46 local file hashes

✗ Verification failed! 16 file(s) have issues

Total files: 62
✓ Passed: 46
✗ Failed: 16

Failed files:
✗ config.json (missing)
✗ encoding/encoding_dsv4.py (missing)
✗ encoding/test_encoding_dsv4.py (missing)
✗ encoding/tests/test_input_1.json (missing)
✗ encoding/tests/test_input_2.json (missing)
✗ encoding/tests/test_input_3.json (missing)
✗ encoding/tests/test_input_4.json (missing)
✗ generation_config.json (missing)
✗ inference/config.json (missing)
✗ inference/convert.py (missing)
✗ inference/generate.py (missing)
✗ inference/kernel.py (missing)
✗ inference/model.py (missing)
✗ model.safetensors.index.json (missing)
✗ tokenizer.json (missing)
✗ tokenizer_config.json (missing)

Do you want to repair (re-download) the failed files? [y/n] (y): n
[WARNING] Field "span" in type "ir.TupleType" duplicates an ancestor field in "ir.Type". Child types should not re-register inherited fields.
[WARNING] Field "span" in type "ir.FuncType" duplicates an ancestor field in "ir.Type". Child types should not re-register inherited fields.
[WARNING] Field "span" in type "ir.TensorMapType" duplicates an ancestor field in "ir.Type". Child types should not re-register inherited fields.
[WARNING] Field "binding_blocks" in type "script.ir_builder.relax.FunctionFrame" duplicates an ancestor field in "script.ir_builder.relax.SeqExprFrame". Child types should not re-register inherited fields.
[WARNING] Field "output" in type "script.ir_builder.relax.FunctionFrame" duplicates an ancestor field in "script.ir_builder.relax.SeqExprFrame". Child types should not re-register inherited fields.
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'span' in 'ir.TupleType' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'span' in 'ir.FuncType' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'span' in 'ir.TensorMapType' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'name' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'tag' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'attrs' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'shape' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'dtype' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
[WARNING] Field "policy_type" in type "tl.GemmSPWarpPolicy" duplicates an ancestor field in "tl.GemmWarpPolicy". Child types should not re-register inherited fields.
[WARNING] Field "m_warp" in type "tl.GemmSPWarpPolicy" duplicates an ancestor field in "tl.GemmWarpPolicy". Child types should not re-register inherited fields.
[WARNING] Field "n_warp" in type "tl.GemmSPWarpPolicy" duplicates an ancestor field in "tl.GemmWarpPolicy". Child types should not re-register inherited fields.
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'policy_type' in 'tl.GemmSPWarpPolicy' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'm_warp' in 'tl.GemmSPWarpPolicy' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'n_warp' in 'tl.GemmSPWarpPolicy' duplicates an ancestor field. Child types should not re-register inherited fields.
info = core._register_object_by_index(type_index, cls)
[2026-07-21 21:40:12] WARNING registry.py:107: In import_model_classes: Ignore import error when loading sglang.srt.models.glm_ocr: No module named 'transformers.models.glm_ocr'
[2026-07-21 21:40:12] WARNING registry.py:107: In import_model_classes: Ignore import error when loading sglang.srt.models.glm_ocr_nextn: No module named 'transformers.models.glm_ocr'
[2026-07-21 21:40:12] WARNING registry.py:107: In import_model_classes: Ignore import error when loading sglang.srt.models.glmasr: cannot import name 'GlmAsrConfig' from 'transformers' (/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/transformers/__init__.py)

Select a MoE model to verify:

┏━━━━━━┳━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━┳━━━━━━━━━┳━━━━━━━━┓
┃ # ┃ 名称 ┃ Path ┃ Total ┃ Exps ┃ Act ┃ 仓库 ┃ SHA256 ┃
┡━━━━━━╇━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━╇━━━━━━━━━╇━━━━━━━━┩
│ 1 │ Deepseek-V4-Flash │ /media/ │ 148.7 │ 256 │ 6 │ hf:deep │ ✗ │
│ │ │ deepsee │ GB │ │ │ seek-ai │ │
│ │ │ ker/Lin │ │ │ │ /deepse │ │
│ │ │ ux_Mode │ │ │ │ ek-v4-f │ │
│ │ │ ling/De │ │ │ │ lash │ │
│ │ │ epseek/ │ │ │ │ │ │
│ │ │ Model/D │ │ │ │ │ │
│ │ │ eepseek │ │ │ │ │ │
│ │ │ -V4F │ │ │ │ │ │
└──────┴───────────────────┴─────────┴─────────┴──────┴─────┴─────────┴────────┘

SHA256 Status: ○ Not checked | ✓ Passed | ✗ Failed

q
(/home/deepseeker/桌面/Deepseek_kt6/python) deepseeker@Fishbowl:/media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F$ ls
config.json model-00024-of-00046.safetensors
encoding model-00025-of-00046.safetensors
generation_config.json model-00026-of-00046.safetensors
inference model-00027-of-00046.safetensors
model-00001-of-00046.safetensors model-00028-of-00046.safetensors
model-00002-of-00046.safetensors model-00029-of-00046.safetensors
model-00003-of-00046.safetensors model-00030-of-00046.safetensors
model-00004-of-00046.safetensors model-00031-of-00046.safetensors
model-00005-of-00046.safetensors model-00032-of-00046.safetensors
model-00006-of-00046.safetensors model-00033-of-00046.safetensors
model-00007-of-00046.safetensors model-00034-of-00046.safetensors
model-00008-of-00046.safetensors model-00035-of-00046.safetensors
model-00009-of-00046.safetensors model-00036-of-00046.safetensors
model-00010-of-00046.safetensors model-00037-of-00046.safetensors
model-00011-of-00046.safetensors model-00038-of-00046.safetensors
model-00012-of-00046.safetensors model-00039-of-00046.safetensors
model-00013-of-00046.safetensors model-00040-of-00046.safetensors
model-00014-of-00046.safetensors model-00041-of-00046.safetensors
model-00015-of-00046.safetensors model-00042-of-00046.safetensors
model-00016-of-00046.safetensors model-00043-of-00046.safetensors
model-00017-of-00046.safetensors model-00044-of-00046.safetensors
model-00018-of-00046.safetensors model-00045-of-00046.safetensors
model-00019-of-00046.safetensors model-00046-of-00046.safetensors
model-00020-of-00046.safetensors model.safetensors.index.json
model-00021-of-00046.safetensors tokenizer_config.json
model-00022-of-00046.safetensors tokenizer.json
(/home/deepseeker/桌面/Deepseek_kt6/python) deepseeker@Fishbowl:/media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F$
```

### Others

被KT标记为“丢失”的文件实际上已经存在于文件系统中,而尝试修复会从HF上重新下载这些文件,并准确无误地放回原位;随后又会被标记为“不匹配”或“丢失”。这似乎是没有正确配置路径所导致的。

Contributor guide

Open the contributing guide

Research direction

Start with the `kt model verify Deepseek-V4-Flash` command and compare its reported local path with the listed model directory. Trace how the verifier resolves and checks the remote files, especially those reported missing despite the `ls` output. Done means existing files are recognized at the configured path and verification no longer incorrectly reports them missing or triggers unnecessary downloads.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.