intel / intel/xFasterTransformer
run webdemo meet error when set dytpe bf16_int8 and bf16_fp16
Open
bug
- Dominant language
- C++
- Stars
- 435
- Forks
- 76
- PR merge metrics
- No merged PRs in 30d
Description
dtype 是 bf16_int8 和 bf16_fp16 时，运行run.sh都会直接 killed
[web_demo混合精度.zip](https://github.com/intel/xFasterTransformer/files/13373914/web_demo.zip)
Contributor guide
Assessment
This issue has not been assessed yet.