Request: Token Count on Gemini (all) APIs
Open
enhancement
- Dominant language
- Python
- Stars
- 38.6k
- Forks
- 2.7k
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 3
Description
Hola,
First off, very cool library! Thank you for sharing.
I haven't delved too deep into the codebase, and may just fork and add this feature myself if it isn't planned, but I'd like to retrieve token counts from the ai providers (specifically Gemini). I'm unsure how that interacts with the library, though. Does each 'pass' send the entire document, prompt and all, to the API, so each call would be multiplied by the number of passes?
Either way, are token counts planned to be included generally?
Thanks again!
Contributor guide
Assessment
This issue has not been assessed yet.