redpanda-data / redpanda-data/connect

FR: TTL support for the MongoDB cache

Open
#2,959 0 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement mongodb needs investigation ux
Dominant language
Go
Stars
8.8k
Forks
969
Avg merge
1d 13h
Merged PRs (30d)
64

Description

MongoDB supports TTL indexes. If Connect allowed the user to specify the name of a Date field and a timestamp value, then writing said value to said field, one could easily implement a TTL policy for the MongoDB cache.

Between quorum write acknowledgements and the WiredTiger page management, MongoDB is actually a very good key-value store/cache. The TTL functionality would be a fantastic addition.

Thanks!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the MongoDB cache configuration and write path, then review MongoDB's TTL index documentation linked in the issue. Determine how users would provide the Date field name and timestamp value, and define completion around those values being written so MongoDB can enforce expiration.

Written by the indexing model from the issue text.

Assessment

Tech stack
mongodb
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.