Confusion about the prompt size
未关闭
- 主要语言
- Rust
- 星标
- 619
- 派生
- 74
- PR 合并指标
- 30 天内没有已合并 PR
描述
I'm trying to play with rwkv's long context capabilities. As far as I understand, the linked https://huggingface.co/cgisky/RWKV-x070-Ai00/tree/main/world_v3/3b model should be enough for the RWKV capabilities of really long prompts, right? When I cross a few thousand characters (using the oapi endpoint and the test python script from this repo), I start getting silly responses. This happens even after bumping up max_tokens.
Am I misunderstanding what's possible to do here? Or doing something wrong?
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。