prompt injection uses a TON of tokens.
- 主要语言
- 没有语言数据
- 星标
- 2.1k
- 派生
- 153
- PR 合并指标
- 30 天内没有已合并 PR
描述
prompt injection uses a TON of tokens. If I have plugins they are used globally, and as such they're injected into every prompt. It means if I'm using local models (or heck even just doing API cost) theres a ton of tokens I don't always need. We need a way to tie plugins to sessions, or specific workflows. A way to enable or disable them situationally instead of just globally. A local model can NEVER be used with this app unless it has minimum 64k context window, but 128k is better. Even with that, session length must be kept short so as not to overwhelm the models.
---
| Field | Value |
| --- | --- |
| App version | 1.0.17 |
| OS | macOS 26.5.2 |
| Theme | GitHub |
| Path | /chat |
| Tenure | Week 14 |
贡献指南
调研方向
从 /chat 入口开始,跟踪插件如何包含在提示中,以及会话或工作流如何表示。定义如何按会话或工作流启用或禁用插件,然后验证未使用的插件会从提示中排除,并且聊天在模型上下文窗口更短的情况下仍能正常工作。
由索引模型根据 Issue 内容生成。
评估
- 领域
- ai, desktop
- Issue 类型
- 功能
- 难度
- 5/5
- 预计耗时
- 一周以上
- 活跃度
- 冷清
- 描述清晰度
- 基本清楚
- 新手友好度
- 35/100