Abraxas-365 / Abraxas-365/langchain-rust

Token counter to Agentes

未關閉
#6 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Rust
星號
1.3k
分支
177
PR 合併指標
30 天內沒有已合併 PR

描述

# Description:
We propose implementing a token counter functionality within Agentes. This feature aims to collect all the prompt and output tokens of the large language model (LLM) and include them in the Agent executor chain result upon calling the Call function.

This enhancement would provide valuable insights into the token usage patterns of the LLM during execution, which can be beneficial for various purposes such as analyzing model behavior, optimizing resource utilization, and debugging.

貢獻指南

開啟貢獻指南

研究方向

Look for the Agent executor chain and the Call function in the codebase to understand how prompts and outputs are currently handled. Identify where LLM interactions occur to instrument token counting. The result structure needs to be extended to include token counts. Check existing tests for the executor to see how to validate the new functionality.

由索引模型根據 Issue 內容生成。

評估

技術堆疊
rust
領域
ai-infra-agents
Issue 類型
功能
難度
3/5
預估耗時
1-2 天
活躍度
停滯
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。