use chatglm-6b. error: trust_remote_code=True
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
use : python -m fastchat.serve.cli --model model/
model incloud :pytorch_model-00001-of-00008.bin .....
tokenization_config
{
"name_or_path": "THUDM/chatglm-6b",
"bos_token": "",
"eos_token": "",
"end_token": "",
"gmask_token": "[gMASK]",
"mask_token": "[MASK]",
"pad_token": "",
"unk_token": "",
"remove_space": false,
"do_lower_case": false,
"tokenizer_class": "ChatGLMTokenizer",
"num_image_tokens": 0,
"auto_map": {
"AutoTokenizer": [
"tokenization_chatglm.ChatGLMTokenizer",
null
]
}
}
if add trust_remote_code=True
{
....
"num_image_tokens": 0,
"trust_remote_cod":True,
"auto_map": {
"AutoTokenizer": [
"tokenization_chatglm.ChatGLMTokenizer",
null
]
}
}
next error:
JSONDecodeError,because add "trust_remote_cod":True.
please tell me ,how to edit it?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the command `python -m fastchat.serve.cli --model model/` with the shown ChatGLM-6B files and inspect how the CLI reads `tokenization_config`. Check the handling of `trust_remote_code` and the resulting JSONDecodeError. Done means the model configuration is loaded without that parsing error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, cli
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100