crewAIInc / crewAIInc/crewAI

Add Valkey as a storage backend for CrewAI memory

Open
#7,549 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

vendor-pitch
Dominant language
Python
Stars
58.8k
Forks
8.5k
Avg merge
1d 15h
Merged PRs (30d)
109

Description

Summary

Add Valkey as a storage backend for CrewAI's memory
system — a vector-search-capable store for short/long-term memory, plus a
shared cache usable by A2A and file uploads. Valkey is an open-source,
BSD-licensed fork of Redis, so this gives users a self-hostable, license-clean
alternative to the existing storage options.

Opening this to track the work per @Vidit-Ostwal's request while the repo
cleanup and the third-party-integration/configuration discussion are underway.

Status: implementation essentially complete

The work is already built, tested, and split across four open PRs (broken up at
an earlier reviewer's request for smaller, easier-to-review diffs). They are
rebased on latest main, CI is green, and CodeRabbit has passed. Best reviewed
in order:

  • #5700 — shared cache config + ValkeyCache (foundation for A2A and file uploads)
  • #5701 — harden memory tool input validation
  • #5702 — async-safe embeddings + resilient drain_writes
  • #5703 — ValkeyStorage vector memory backend (depends on #5700 and #5702)

Notes

  • No changes are needed from maintainers right now — this issue is for tracking.
    I understand the third-party-provider/configuration direction is still under
    internal discussion, and I'm happy to adapt the PRs (e.g. how the backend is
    registered/configured) to fit whatever pattern you land on.
  • The implementation uses Valkey-GLIDE and the Valkey Search module for vector
    similarity (FLAT/HNSW), with scope/category/metadata filtering.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The implementation is already split across PRs #5700, #5701, #5702, and #5703; review them in that order, starting with the shared cache foundation. Check the Valkey-GLIDE, Valkey Search, configuration, validation, and async-write behavior described in the issue. The work is done when the PR series is reviewed and its four listed capabilities are accepted.

Written by the indexing model from the issue text.

Assessment

Domain
backend, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
10/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.