ByteDance-Seed / ByteDance-Seed/seed-oss

missing chat template

Open
#6 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
891
Forks
53
PR merge metrics
No merged PRs in 30d

Description

Traceback (most recent call last):
File "/home/zhilong/seed-oss/inference/vllm_chat.py", line 20, in
response = client.chat.completions.create(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/_utils/_utils.py", line 287, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
return self._post(
^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/_base_client.py", line 1259, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhilong/miniconda3/lib/python3.12/site-packages/openai/_base_client.py", line 1047, in request
raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'error': {'message': 'As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one. None', 'type': 'BadRequestError', 'param': None, 'code': 400}}

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with inference/vllm_chat.py at the chat completion call shown in the traceback, then inspect the model and tokenizer configuration used by that entry point. Reproduce the request and verify that it no longer fails with the Transformers v4.44 missing chat-template error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.