ByteDance-Seed / ByteDance-Seed/seed-oss
missing chat template
- Dominant language
- Python
- Stars
- 891
- Forks
- 53
- PR merge metrics
- No merged PRs in 30d
Description
Traceback (most recent call last):
File "/home/zhilong/seed-oss/inference/vllm_chat.py", line 20, in
response = client.chat.completions.create(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/_utils/_utils.py", line 287, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
return self._post(
^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/_base_client.py", line 1259, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/_base_client.py", line 1047, in request
raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'error': {'message': 'As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one. None', 'type': 'BadRequestError', 'param': None, 'code': 400}}
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with inference/vllm_chat.py at the chat completion call shown in the traceback, then inspect the model and tokenizer configuration used by that entry point. Reproduce the request and verify that it no longer fails with the Transformers v4.44 missing chat-template error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100