alipay / alipay/PainlessInferenceAcceleration

请问解决了训推不一致的问题吗?即生成的token概率和 transformer生成的token概率不一致

Open
#46 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
370
Forks
23
PR merge metrics
No merged PRs in 30d

Description

请问解决了训推不一致的问题吗?即生成的token概率和 transformer生成的token概率不一致

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.