Abraxas-365 / Abraxas-365/langchain-rust
Token counter to Agentes
- 主要語言
- Rust
- 星號
- 1.3k
- 分支
- 177
- PR 合併指標
- 30 天內沒有已合併 PR
描述
# Description:
We propose implementing a token counter functionality within Agentes. This feature aims to collect all the prompt and output tokens of the large language model (LLM) and include them in the Agent executor chain result upon calling the Call function.
This enhancement would provide valuable insights into the token usage patterns of the LLM during execution, which can be beneficial for various purposes such as analyzing model behavior, optimizing resource utilization, and debugging.
貢獻指南
研究方向
Look for the Agent executor chain and the Call function in the codebase to understand how prompts and outputs are currently handled. Identify where LLM interactions occur to instrument token counting. The result structure needs to be extended to include token counts. Check existing tests for the executor to see how to validate the new functionality.
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- rust
- 領域
- ai-infra-agents
- Issue 類型
- 功能
- 難度
- 3/5
- 預估耗時
- 1-2 天
- 活躍度
- 停滯
- 描述清晰度
- 基本清楚
- 新手友好度
- 45/100