cloudflare / cloudflare/agents

Memory: support multimodal content (files, images, audio, artifacts)

Open
#1,392 0 comments 1 reaction 1 assignee Claimed by @mattzcarey View on GitHub
enhancement on the roadmap
Dominant language
TypeScript
Stars
5.6k
Forks
711
Avg merge
1d 20h
Merged PRs (30d)
53

Description

Proposed by a user building serverless agents.

The current memory/context providers are mostly string-based, which is a good starting point. For multimodal agents, it would be useful to also remember files, images, audio, PDFs, generated artifacts, and their derived text.

Real-world agents work with more than text. An agent might:
- Generate a chart and need to reference it later
- Receive a PDF and extract key facts from it
- Record audio notes and recall them in a future session
- Produce code artifacts that should persist as part of the agent's memory

Today these would need to be stored and retrieved out-of-band, with only a text summary saved to memory.

It might make sense to store text and metadata in Durable Object SQLite, while larger binary assets live in R2. This would keep the current simple text-first API working unchanged, while allowing agents that need multimodal recall to opt in.

(Replaces #1388, #1390)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.