AgentOps-AI / AgentOps-AI/tokencost

Is this package capable of calculating tokens for OpenAI assistant mode and more advanced chats?

Aberta
#58 4 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Python
Estrelas
2k
Forks
105
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição

Hello,
I noticed that the code package you wrote is very impressive. However, is it only capable of counting tokens for regular simple chats?

I saw your code requires the input prompt to include "role", "user", and "content" strings.....

`message_prompt = [{ "role": "user", "content": "Hello world"}]`

If using the assistant mode with instructions, file search, and uploading files to vector stores for RAG, the calculation might be more complex.

Are the token calculation methods for gpt-4-1106-preview and gpt4o the same?
I checked the tokenizer on the official website, but the tokenizer for gpt4o is not yet available:
https://platform.openai.com/tokenizer

Currently, my code for calculating tokens is as follows. Is this correct?
Thank you.

`import tiktoken
encoding = tiktoken.encoding_for_model("gpt-4-1106-preview")
token_contents = len(encoding.encode(contents))
`

Guia de contribuição

Nenhum guia de contribuição indexado para este repositório

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.