a16z-infra / a16z-infra/companion-app

Use Zep for chat history; auto-summarization, intent extraction

Open
#54 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
6k
Forks
950
PR merge metrics
No merged PRs in 30d

Description

Please consider using [Zep ](https://docs.getzep.com/) as a long-term chat history store. It's increasingly being used for larger Langchain / Langchain.js apps where a more sophisticated approach to chat history memory is required.

A snippet from the project's feature list:
- Fast! Zep's async extractors operate independently of the your chat loop, ensuring a snappy user experience.
- Long-term memory persistence, with access to historical messages irrespective of your summarization strategy.
- Auto-summarization of memory messages based on a configurable message window.
- Hybrid Vector search over memories and metadata, with messages automatically embedded on creation.
- Entity Extractor that extracts named entities and intents from messages and stores them in the message metadata.
- Auto-token counting of memories and summaries, allowing finer-grained control over prompt assembly.

Zep's GitHub repo: https://github.com/getzep/zep

Happy to assist with implementation + questions.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.