intel / intel/xFasterTransformer

chatglm3 6b error

Open
#335 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
435
Forks
76
PR merge metrics
No merged PRs in 30d

Description

bash ./run_benchmark.sh -m chatglm3-6b -d nf4 -s 1 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d int4 -s 1 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_nf4 -s 1 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int4 -s 1 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d w8a8_nf4 -s 1 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d w8a8_int4 -s 1 -bs 1 -in 256 -out 256 -i 1

bash ./run_benchmark.sh -m chatglm3-6b -d bf16 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d int8 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d nf4 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_fp16 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_w8a8 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int8 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int4 -s 2 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16_nf4 -s 2 -bs 1 -in 256 -out 256 -i 1

执行上述命令会报错,报错信息如下:
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 0 PID 2425 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================

===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 1 PID 2426 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================

===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 2 PID 2427 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================

===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 3 PID 2428 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================

===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 4 PID 2429 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================

===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 7 PID 2432 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.