sgl-project / sgl-project/SpecForge

[Bug] TypeError: 'SGLangEagle3TargetModel' object is not callable

Open
#360 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.2k
Forks
347
Avg merge
4d 1h
Merged PRs (30d)
41

Description

Checklist
  • 1. I have searched related issues but cannot get the expected help.
  • 2. The bug has not been fixed in the latest version.
  • 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
  • 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/sgl-project/SpecForge/discussions/new/choose Otherwise, it will be closed.
  • 5. Please use English, otherwise it will be closed.
Describe the bug

Error occured when run examples/run_qwen2.5_7b_vl_eagle3_online.sh
TypeError: 'SGLangEagle3TargetModel' object is not callable

Reproduction

The latest SpecForge installed by running: pip install -r requirements.txt

After prepare the dataset, we run bash examples/run_qwen2.5_7b_vl_eagle3_online

Environment

(specforge-llm) idc@HGX-082:~$ conda list

packages in environment at /home/idc/mambaforge/envs/specforge-llm:

Name Version Build Channel

_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 2_gnu conda-forge
accelerate 1.12.0 pypi_0 pypi
addict 2.4.0 pypi_0 pypi
aiohappyeyeballs 2.6.1 pypi_0 pypi
aiohttp 3.13.2 pypi_0 pypi
aiosignal 1.4.0 pypi_0 pypi
airportsdata 20250909 pypi_0 pypi
annotated-doc 0.0.4 pypi_0 pypi
annotated-types 0.7.0 pypi_0 pypi
anthropic 0.75.0 pypi_0 pypi
anyio 4.12.0 pypi_0 pypi
apache-tvm-ffi 0.1.4 pypi_0 pypi
asttokens 3.0.1 pypi_0 pypi
async-timeout 5.0.1 pypi_0 pypi
attrs 25.4.0 pypi_0 pypi
av 16.0.1 pypi_0 pypi
blobfile 3.0.0 pypi_0 pypi
build 1.3.0 pypi_0 pypi
bzip2 1.0.8 hda65f42_8 conda-forge
ca-certificates 2025.11.12 hbd8a1cb_0 conda-forge
certifi 2025.11.12 pypi_0 pypi
cffi 2.0.0 pypi_0 pypi
cfgv 3.5.0 pypi_0 pypi
charset-normalizer 3.4.4 pypi_0 pypi
click 8.3.1 pypi_0 pypi
cloudpickle 3.1.2 pypi_0 pypi
compressed-tensors 0.12.2 pypi_0 pypi
contourpy 1.3.2 pypi_0 pypi
cuda-bindings 13.0.3 pypi_0 pypi
cuda-pathfinder 1.3.2 pypi_0 pypi
cuda-python 13.0.3 pypi_0 pypi
cycler 0.12.1 pypi_0 pypi
datasets 4.4.1 pypi_0 pypi
decorator 5.2.1 pypi_0 pypi
decord 0.6.0 pypi_0 pypi
decord2 2.0.0 pypi_0 pypi
dill 0.3.8 pypi_0 pypi
diskcache 5.6.3 pypi_0 pypi
distlib 0.4.0 pypi_0 pypi
distro 1.9.0 pypi_0 pypi
docstring-parser 0.17.0 pypi_0 pypi
einops 0.8.1 pypi_0 pypi
exceptiongroup 1.3.1 pypi_0 pypi
executing 2.2.1 pypi_0 pypi
expecttest 0.3.0 pypi_0 pypi
fastapi 0.123.1 pypi_0 pypi
filelock 3.20.0 pypi_0 pypi
flashinfer-cubin 0.5.0 pypi_0 pypi
flashinfer-python 0.5.0 pypi_0 pypi
fonttools 4.61.0 pypi_0 pypi
frozenlist 1.8.0 pypi_0 pypi
fsspec 2024.2.0 pypi_0 pypi
gguf 0.17.1 pypi_0 pypi
gitdb 4.0.12 pypi_0 pypi
gitpython 3.1.45 pypi_0 pypi
grpcio 1.75.1 pypi_0 pypi
grpcio-health-checking 1.75.1 pypi_0 pypi
grpcio-reflection 1.75.1 pypi_0 pypi
grpcio-tools 1.75.1 pypi_0 pypi
h11 0.16.0 pypi_0 pypi
hf-transfer 0.1.9 pypi_0 pypi
hf-xet 1.2.0 pypi_0 pypi
httpcore 1.0.9 pypi_0 pypi
httpx 0.28.1 pypi_0 pypi
huggingface-hub 0.36.0 pypi_0 pypi
identify 2.6.15 pypi_0 pypi
idna 3.11 pypi_0 pypi
iniconfig 2.3.0 pypi_0 pypi
interegular 0.3.3 pypi_0 pypi
ipython 8.37.0 pypi_0 pypi
jedi 0.19.2 pypi_0 pypi
jinja2 3.1.6 pypi_0 pypi
jiter 0.12.0 pypi_0 pypi
joblib 1.5.2 pypi_0 pypi
jsonlines 4.0.0 pypi_0 pypi
jsonschema 4.25.1 pypi_0 pypi
jsonschema-specifications 2025.9.1 pypi_0 pypi
kiwisolver 1.4.9 pypi_0 pypi
lark 1.3.1 pypi_0 pypi
ld_impl_linux-64 2.45 default_hbd61a6d_104 conda-forge
libexpat 2.7.3 hecca717_0 conda-forge
libffi 3.5.2 h9ec8514_0 conda-forge
libgcc 15.2.0 he0feb66_14 conda-forge
libgcc-ng 15.2.0 h69a702a_14 conda-forge
libgomp 15.2.0 he0feb66_14 conda-forge
liblzma 5.8.1 hb9d3cd8_2 conda-forge
libnsl 2.0.1 hb9d3cd8_1 conda-forge
libsqlite 3.51.1 h0c1763c_0 conda-forge
libuuid 2.41.2 he9a06e4_0 conda-forge
libxcrypt 4.4.36 hd590300_1 conda-forge
libzlib 1.3.1 hb9d3cd8_2 conda-forge
llguidance 0.7.30 pypi_0 pypi
loguru 0.7.3 pypi_0 pypi
lxml 6.0.2 pypi_0 pypi
markupsafe 3.0.3 pypi_0 pypi
matplotlib 3.10.7 pypi_0 pypi
matplotlib-inline 0.2.1 pypi_0 pypi
modelscope 1.32.0 pypi_0 pypi
mpmath 1.3.0 pypi_0 pypi
msgspec 0.20.0 pypi_0 pypi
multidict 6.7.0 pypi_0 pypi
multiprocess 0.70.16 pypi_0 pypi
ncurses 6.5 h2d0b736_3 conda-forge
nest-asyncio 1.6.0 pypi_0 pypi
networkx 3.4.2 pypi_0 pypi
ninja 1.13.0 pypi_0 pypi
nodeenv 1.9.1 pypi_0 pypi
numpy 2.2.6 pypi_0 pypi
nvidia-cublas-cu12 12.8.4.1 pypi_0 pypi
nvidia-cuda-cupti-cu12 12.8.90 pypi_0 pypi
nvidia-cuda-nvrtc-cu12 12.8.93 pypi_0 pypi
nvidia-cuda-runtime-cu12 12.8.90 pypi_0 pypi
nvidia-cudnn-cu12 9.10.2.21 pypi_0 pypi
nvidia-cudnn-frontend 1.16.0 pypi_0 pypi
nvidia-cufft-cu12 11.3.3.83 pypi_0 pypi
nvidia-cufile-cu12 1.13.1.3 pypi_0 pypi
nvidia-curand-cu12 10.3.9.90 pypi_0 pypi
nvidia-cusolver-cu12 11.7.3.90 pypi_0 pypi
nvidia-cusparse-cu12 12.5.8.93 pypi_0 pypi
nvidia-cusparselt-cu12 0.7.1 pypi_0 pypi
nvidia-cutlass-dsl 4.2.1 pypi_0 pypi
nvidia-ml-py 13.580.82 pypi_0 pypi
nvidia-nccl-cu12 2.27.3 pypi_0 pypi
nvidia-nvjitlink-cu12 12.8.93 pypi_0 pypi
nvidia-nvtx-cu12 12.8.90 pypi_0 pypi
openai 2.6.1 pypi_0 pypi
openai-harmony 0.0.4 pypi_0 pypi
openssl 3.6.0 h26f9b46_0 conda-forge
orjson 3.11.4 pypi_0 pypi
outlines 0.1.11 pypi_0 pypi
outlines-core 0.1.26 pypi_0 pypi
packaging 25.0 pypi_0 pypi
pandas 2.3.3 pypi_0 pypi
parso 0.8.5 pypi_0 pypi
partial-json-parser 0.2.1.1.post7 pypi_0 pypi
peft 0.18.0 pypi_0 pypi
pexpect 4.9.0 pypi_0 pypi
pillow 12.0.0 pypi_0 pypi
pip 25.3 pyh8b19718_0 conda-forge
platformdirs 4.5.0 pypi_0 pypi
pluggy 1.6.0 pypi_0 pypi
pre-commit 4.5.0 pypi_0 pypi
prometheus-client 0.23.1 pypi_0 pypi
prompt-toolkit 3.0.52 pypi_0 pypi
propcache 0.4.1 pypi_0 pypi
protobuf 6.33.1 pypi_0 pypi
psutil 7.1.3 pypi_0 pypi
ptyprocess 0.7.0 pypi_0 pypi
pure-eval 0.2.3 pypi_0 pypi
py-spy 0.4.1 pypi_0 pypi
pyarrow 22.0.0 pypi_0 pypi
pyarrow-hotfix 0.7 pypi_0 pypi
pybase64 1.4.2 pypi_0 pypi
pycountry 24.6.1 pypi_0 pypi
pycparser 2.23 pypi_0 pypi
pycryptodomex 3.23.0 pypi_0 pypi
pydantic 2.12.5 pypi_0 pypi
pydantic-core 2.41.5 pypi_0 pypi
pygments 2.19.2 pypi_0 pypi
pynvml 13.0.1 pypi_0 pypi
pyparsing 3.2.5 pypi_0 pypi
pyproject-hooks 1.2.0 pypi_0 pypi
pytest 9.0.2 pypi_0 pypi
python 3.10.19 h3c07f61_2_cpython conda-forge
python-dateutil 2.9.0.post0 pypi_0 pypi
python-multipart 0.0.20 pypi_0 pypi
pytz 2025.2 pypi_0 pypi
pyyaml 6.0.3 pypi_0 pypi
pyzmq 27.1.0 pypi_0 pypi
qwen-vl-utils 0.0.11 pypi_0 pypi
readline 8.2 h8c095d6_2 conda-forge
referencing 0.37.0 pypi_0 pypi
regex 2025.11.3 pypi_0 pypi
requests 2.32.5 pypi_0 pypi
rpds-py 0.30.0 pypi_0 pypi
safetensors 0.7.0 pypi_0 pypi
scikit-learn 1.7.2 pypi_0 pypi
scipy 1.15.3 pypi_0 pypi
sentence-transformers 5.1.2 pypi_0 pypi
sentencepiece 0.2.1 pypi_0 pypi
sentry-sdk 2.46.0 pypi_0 pypi
setproctitle 1.3.7 pypi_0 pypi
setuptools 80.9.0 pyhff2d567_0 conda-forge
sgl-kernel 0.3.16.post5 pypi_0 pypi
sglang 0.5.5 pypi_0 pypi
six 1.17.0 pypi_0 pypi
smmap 5.0.2 pypi_0 pypi
sniffio 1.3.1 pypi_0 pypi
soundfile 0.13.1 pypi_0 pypi
specforge 0.1.1 pypi_0 pypi
stack-data 0.6.3 pypi_0 pypi
starlette 0.50.0 pypi_0 pypi
sympy 1.14.0 pypi_0 pypi
tabulate 0.9.0 pypi_0 pypi
threadpoolctl 3.6.0 pypi_0 pypi
tiktoken 0.12.0 pypi_0 pypi
timm 1.0.16 pypi_0 pypi
tk 8.6.13 noxft_ha0e22de_103 conda-forge
tokenizers 0.22.1 pypi_0 pypi
tomli 2.3.0 pypi_0 pypi
torch 2.8.0 pypi_0 pypi
torch-memory-saver 0.0.9 pypi_0 pypi
torchao 0.9.0 pypi_0 pypi
torchaudio 2.8.0 pypi_0 pypi
torchvision 0.23.0 pypi_0 pypi
tqdm 4.67.1 pypi_0 pypi
traitlets 5.14.3 pypi_0 pypi
transformers 4.57.1 pypi_0 pypi
triton 3.4.0 pypi_0 pypi
typing-extensions 4.15.0 pypi_0 pypi
typing-inspection 0.4.2 pypi_0 pypi
tzdata 2025.2 pypi_0 pypi
urllib3 2.5.0 pypi_0 pypi
uvicorn 0.38.0 pypi_0 pypi
uvloop 0.22.1 pypi_0 pypi
virtualenv 20.35.4 pypi_0 pypi
wandb 0.23.0 pypi_0 pypi
wcwidth 0.2.14 pypi_0 pypi
wheel 0.45.1 pyhd8ed1ab_1 conda-forge
xgrammar 0.1.25 pypi_0 pypi
xxhash 3.6.0 pypi_0 pypi
yarl 1.22.0 pypi_0 pypi

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running examples/run_qwen2.5_7b_vl_eagle3_online.sh after preparing the dataset, and inspect the traceback around the SGLangEagle3TargetModel TypeError. Trace the example's model invocation to determine why the object is called; done means the example runs without this error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.