a16z-infra / a16z-infra/companion-app

Use Zep for chat history; auto-summarization, intent extraction

Aberta
#54 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
TypeScript
Estrelas
6k
Forks
950
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição

Please consider using [Zep ](https://docs.getzep.com/) as a long-term chat history store. It's increasingly being used for larger Langchain / Langchain.js apps where a more sophisticated approach to chat history memory is required.

A snippet from the project's feature list:
- Fast! Zep's async extractors operate independently of the your chat loop, ensuring a snappy user experience.
- Long-term memory persistence, with access to historical messages irrespective of your summarization strategy.
- Auto-summarization of memory messages based on a configurable message window.
- Hybrid Vector search over memories and metadata, with messages automatically embedded on creation.
- Entity Extractor that extracts named entities and intents from messages and stores them in the message metadata.
- Auto-token counting of memories and summaries, allowing finer-grained control over prompt assembly.

Zep's GitHub repo: https://github.com/getzep/zep

Happy to assist with implementation + questions.

Guia de contribuição

Nenhum guia de contribuição indexado para este repositório

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.