No module named 'fastchat.eval',what I need todo?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
code here report bug: ModuleNotFoundError: No module named 'fastchat.eval'
result = subprocess.run([
"python", "-m", "fastchat.eval.run_judger",
"--model-list", config["name"],
"--question-file", self.test_file,
"--answer-dir", str(self.output_dir)
], capture_output=True, text=True)
if result.returncode != 0:
print(f"❌ {model_id} 答案生成失败: {result.stderr}")
else:
print(f"✅ {model_id} 答案生成完成")
❌ llama-8b 答案生成失败: /root/miniconda3/bin/python: Error while finding module specification for 'fastchat.eval.run_judger' (ModuleNotFoundError: No module named 'fastchat.eval')
I run in the environment below:
(base) root@autodl-container-a53c499c18-c2364a87:~/autodl-tmp/FastChat/fastchat/llm_judge/test# which python /root/miniconda3/bin/python (base) root@autodl-container-a53c499c18-c2364a87:~/autodl-tmp/FastChat/fastchat/llm_judge/test# python --version Python 3.12.2
before I run the code ,I install the needed packages : cd FastChat and pip install -e ".[model_worker,webui,eval]"
I think these packages are installed in the Python 3.12.2, and I also run my test in the environment .so why the moudle 'fastchat.eval' not found ?where It should be found ? in the conda installed package ? or in the projects contexts?
(base) root@autodl-container-a53c499c18-c2364a87:~/autodl-tmp/FastChat# pip install -e ".[model_worker,webui,eval]" Looking in indexes: http://mirrors.aliyun.com/pypi/simple Obtaining file:///root/autodl-tmp/FastChat Installing build dependencies ... done Checking if build backend supports build_editable ... done Getting requirements to build editable ... done Preparing editable metadata (pyproject.toml) ... done Requirement already satisfied: aiohttp in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (3.12.15) Requirement already satisfied: fastapi in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.116.1) Requirement already satisfied: httpx in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.27.2) Requirement already satisfied: markdown2[all] in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (2.5.4) Requirement already satisfied: nh3 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.3.0) Requirement already satisfied: numpy in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (2.1.3) Requirement already satisfied: prompt_toolkit>=3.0.0 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (3.0.48) Requirement already satisfied: pydantic<3,>=2.0.0 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (2.11.7) Requirement already satisfied: pydantic-settings in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (2.10.1) Requirement already satisfied: psutil in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (6.1.0) Requirement already satisfied: requests in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (2.32.4) Requirement already satisfied: rich>=10.0.0 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (14.1.0) Requirement already satisfied: shortuuid in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (1.0.13) Requirement already satisfied: tiktoken in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.11.0) Requirement already satisfied: uvicorn in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.35.0) WARNING: fschat 0.2.36 does not provide the extra 'eval' Requirement already satisfied: accelerate>=0.21 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (1.10.1) Requirement already satisfied: peft in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.17.1) Requirement already satisfied: sentencepiece in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.2.1) Requirement already satisfied: torch in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (2.5.1+cu124) Requirement already satisfied: transformers>=4.31.0 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (4.56.0) Requirement already satisfied: protobuf in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (5.28.3) Requirement already satisfied: openai in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (1.102.0) Requirement already satisfied: anthropic in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (0.64.0) Requirement already satisfied: gradio>=4.10 in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (5.44.1) Requirement already satisfied: plotly in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (6.3.0) Requirement already satisfied: scipy in /root/miniconda3/lib/python3.12/site-packages (from fschat==0.2.36) (1.16.1) Requirement already satisfied: annotated-types>=0.6.0 in /root/miniconda3/lib/python3.12/site-packages (from pydantic<3,>=2.0.0->fschat==0.2.36) (0.7.0) Requirement already satisfied: pydantic-core==2.33.2 in /root/miniconda3/lib/python3.12/site-packages (from pydantic<3,>=2.0.0->fschat==0.2.36) (2.33.2) Requirement already satisfied: typing-extensions>=4.12.2 in /root/miniconda3/lib/python3.12/site-packages (from pydantic<3,>=2.0.0->fschat==0.2.36) (4.12.2) Requirement already satisfied: typing-inspection>=0.4.0 in /root/miniconda3/lib/python3.12/site-packages (from pydantic<3,>=2.0.0->fschat==0.2.36) (0.4.1) Requirement already satisfied: packaging>=20.0 in /root/miniconda3/lib/python3.12/site-packages (from accelerate>=0.21->fschat==0.2.36) (25.0) Requirement already satisfied: pyyaml in /root/miniconda3/lib/python3.12/site-packages (from accelerate>=0.21->fschat==0.2.36) (6.0.2) Requirement already satisfied: huggingface_hub>=0.21.0 in /root/miniconda3/lib/python3.12/site-packages (from accelerate>=0.21->fschat==0.2.36) (0.34.4) Requirement already satisfied: safetensors>=0.4.3 in /root/miniconda3/lib/python3.12/site-packages (from accelerate>=0.21->fschat==0.2.36) (0.6.2) Requirement already satisfied: aiofiles<25.0,>=22.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (24.1.0) Requirement already satisfied: anyio<5.0,>=3.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (4.6.2.post1) Requirement already satisfied: brotli>=1.1.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (1.1.0) Requirement already satisfied: ffmpy in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.6.1) Requirement already satisfied: gradio-client==1.12.1 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (1.12.1) Requirement already satisfied: groovy~=0.1 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.1.2) Requirement already satisfied: jinja2<4.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (3.1.4) Requirement already satisfied: markupsafe<4.0,>=2.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (3.0.2) Requirement already satisfied: orjson~=3.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (3.11.3) Requirement already satisfied: pandas<3.0,>=1.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (2.3.2) Requirement already satisfied: pillow<12.0,>=8.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (11.0.0) Requirement already satisfied: pydub in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.25.1) Requirement already satisfied: python-multipart>=0.0.18 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.0.20) Requirement already satisfied: ruff>=0.9.3 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.12.11) Requirement already satisfied: safehttpx<0.2.0,>=0.1.6 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.1.6) Requirement already satisfied: semantic-version~=2.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (2.10.0) Requirement already satisfied: starlette<1.0,>=0.40.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.47.3) Requirement already satisfied: tomlkit<0.14.0,>=0.12.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.13.3) Requirement already satisfied: typer<1.0,>=0.12 in /root/miniconda3/lib/python3.12/site-packages (from gradio>=4.10->fschat==0.2.36) (0.17.3) Requirement already satisfied: fsspec in /root/miniconda3/lib/python3.12/site-packages (from gradio-client==1.12.1->gradio>=4.10->fschat==0.2.36) (2024.10.0) Requirement already satisfied: websockets<16.0,>=10.0 in /root/miniconda3/lib/python3.12/site-packages (from gradio-client==1.12.1->gradio>=4.10->fschat==0.2.36) (15.0.1) Requirement already satisfied: idna>=2.8 in /root/miniconda3/lib/python3.12/site-packages (from anyio<5.0,>=3.0->gradio>=4.10->fschat==0.2.36) (3.7) Requirement already satisfied: sniffio>=1.1 in /root/miniconda3/lib/python3.12/site-packages (from anyio<5.0,>=3.0->gradio>=4.10->fschat==0.2.36) (1.3.1) Requirement already satisfied: certifi in /root/miniconda3/lib/python3.12/site-packages (from httpx->fschat==0.2.36) (2025.8.3) Requirement already satisfied: httpcore==1.* in /root/miniconda3/lib/python3.12/site-packages (from httpx->fschat==0.2.36) (1.0.7) Requirement already satisfied: h11<0.15,>=0.13 in /root/miniconda3/lib/python3.12/site-packages (from httpcore==1.*->httpx->fschat==0.2.36) (0.14.0) Requirement already satisfied: filelock in /root/miniconda3/lib/python3.12/site-packages (from huggingface_hub>=0.21.0->accelerate>=0.21->fschat==0.2.36) (3.16.1) Requirement already satisfied: tqdm>=4.42.1 in /root/miniconda3/lib/python3.12/site-packages (from huggingface_hub>=0.21.0->accelerate>=0.21->fschat==0.2.36) (4.67.1) Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /root/miniconda3/lib/python3.12/site-packages (from huggingface_hub>=0.21.0->accelerate>=0.21->fschat==0.2.36) (1.1.9) Requirement already satisfied: python-dateutil>=2.8.2 in /root/miniconda3/lib/python3.12/site-packages (from pandas<3.0,>=1.0->gradio>=4.10->fschat==0.2.36) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in /root/miniconda3/lib/python3.12/site-packages (from pandas<3.0,>=1.0->gradio>=4.10->fschat==0.2.36) (2025.2) Requirement already satisfied: tzdata>=2022.7 in /root/miniconda3/lib/python3.12/site-packages (from pandas<3.0,>=1.0->gradio>=4.10->fschat==0.2.36) (2025.2) Requirement already satisfied: click>=8.0.0 in /root/miniconda3/lib/python3.12/site-packages (from typer<1.0,>=0.12->gradio>=4.10->fschat==0.2.36) (8.2.1) Requirement already satisfied: shellingham>=1.3.0 in /root/miniconda3/lib/python3.12/site-packages (from typer<1.0,>=0.12->gradio>=4.10->fschat==0.2.36) (1.5.4) Requirement already satisfied: wcwidth in /root/miniconda3/lib/python3.12/site-packages (from prompt_toolkit>=3.0.0->fschat==0.2.36) (0.2.13) Requirement already satisfied: six>=1.5 in /root/miniconda3/lib/python3.12/site-packages (from python-dateutil>=2.8.2->pandas<3.0,>=1.0->gradio>=4.10->fschat==0.2.36) (1.16.0) Requirement already satisfied: markdown-it-py>=2.2.0 in /root/miniconda3/lib/python3.12/site-packages (from rich>=10.0.0->fschat==0.2.36) (4.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /root/miniconda3/lib/python3.12/site-packages (from rich>=10.0.0->fschat==0.2.36) (2.18.0) Requirement already satisfied: mdurl~=0.1 in /root/miniconda3/lib/python3.12/site-packages (from markdown-it-py>=2.2.0->rich>=10.0.0->fschat==0.2.36) (0.1.2) Requirement already satisfied: networkx in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (3.4.2) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.4.127 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.4.127) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.4.127 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.4.127) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.4.127 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.4.127) Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (9.1.0.70) Requirement already satisfied: nvidia-cublas-cu12==12.4.5.8 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.4.5.8) Requirement already satisfied: nvidia-cufft-cu12==11.2.1.3 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (11.2.1.3) Requirement already satisfied: nvidia-curand-cu12==10.3.5.147 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (10.3.5.147) Requirement already satisfied: nvidia-cusolver-cu12==11.6.1.9 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (11.6.1.9) Requirement already satisfied: nvidia-cusparse-cu12==12.3.1.170 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.3.1.170) Requirement already satisfied: nvidia-nccl-cu12==2.21.5 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (2.21.5) Requirement already satisfied: nvidia-nvtx-cu12==12.4.127 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.4.127) Requirement already satisfied: nvidia-nvjitlink-cu12==12.4.127 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (12.4.127) Requirement already satisfied: triton==3.1.0 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (3.1.0) Requirement already satisfied: setuptools in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (78.1.1) Requirement already satisfied: sympy==1.13.1 in /root/miniconda3/lib/python3.12/site-packages (from torch->fschat==0.2.36) (1.13.1) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /root/miniconda3/lib/python3.12/site-packages (from sympy==1.13.1->torch->fschat==0.2.36) (1.3.0) Requirement already satisfied: regex!=2019.12.17 in /root/miniconda3/lib/python3.12/site-packages (from transformers>=4.31.0->fschat==0.2.36) (2025.8.29) Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /root/miniconda3/lib/python3.12/site-packages (from transformers>=4.31.0->fschat==0.2.36) (0.22.0) Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (2.6.1) Requirement already satisfied: aiosignal>=1.4.0 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (1.4.0) Requirement already satisfied: attrs>=17.3.0 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (24.2.0) Requirement already satisfied: frozenlist>=1.1.1 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (1.7.0) Requirement already satisfied: multidict<7.0,>=4.5 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (6.6.4) Requirement already satisfied: propcache>=0.2.0 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (0.3.2) Requirement already satisfied: yarl<2.0,>=1.17.0 in /root/miniconda3/lib/python3.12/site-packages (from aiohttp->fschat==0.2.36) (1.20.1) Requirement already satisfied: distro<2,>=1.7.0 in /root/miniconda3/lib/python3.12/site-packages (from anthropic->fschat==0.2.36) (1.9.0) Requirement already satisfied: jiter<1,>=0.4.0 in /root/miniconda3/lib/python3.12/site-packages (from anthropic->fschat==0.2.36) (0.10.0) Requirement already satisfied: wavedrom in /root/miniconda3/lib/python3.12/site-packages (from markdown2[all]->fschat==0.2.36) (2.0.3.post3) Requirement already satisfied: latex2mathml in /root/miniconda3/lib/python3.12/site-packages (from markdown2[all]->fschat==0.2.36) (3.78.1) Requirement already satisfied: narwhals>=1.15.1 in /root/miniconda3/lib/python3.12/site-packages (from plotly->fschat==0.2.36) (2.2.0) Requirement already satisfied: python-dotenv>=0.21.0 in /root/miniconda3/lib/python3.12/site-packages (from pydantic-settings->fschat==0.2.36) (1.1.1) Requirement already satisfied: charset_normalizer<4,>=2 in /root/miniconda3/lib/python3.12/site-packages (from requests->fschat==0.2.36) (3.3.2) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/miniconda3/lib/python3.12/site-packages (from requests->fschat==0.2.36) (2.5.0) Requirement already satisfied: svgwrite in /root/miniconda3/lib/python3.12/site-packages (from wavedrom->markdown2[all]->fschat==0.2.36) (1.4.3) Building wheels for collected packages: fschat Building editable for fschat (pyproject.toml) ... done Created wheel for fschat: filename=fschat-0.2.36-0.editable-py3-none-any.whl size=15133 sha256=2183615636f1e5efbd28d51281e0e8ed6b2dd2f54eef88384cf89059e500d37b Stored in directory: /tmp/pip-ephem-wheel-cache-e70_8wk3/wheels/78/0d/2c/dc0cf44245892a61a51024e8cba64ed8d64eb97ec7f393cf84 Successfully built fschat Installing collected packages: fschat Attempting uninstall: fschat Found existing installation: fschat 0.2.36 Uninstalling fschat-0.2.36: Successfully uninstalled fschat-0.2.36 Successfully installed fschat-0.2.36
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by checking whether the repository contains a fastchat/eval package and whether the editable installation exposes it to the shown Python interpreter. Inspect the fastchat.eval.run_judger entry point and the installation output, then confirm that the documented command either imports successfully or clearly explains the supported evaluation setup.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100