HarperFast / HarperFast/harper

Support streaming blobs for published messages

Open
#141 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
89
Forks
10
Avg merge
2d 2h
Merged PRs (30d)
205

Description

V5.0.0 limits blob usage inside published messages, always embedding the blobs. This is done so that transaction logs can be safely purged by deleting files without requiring the transaction log be scanned for blob references that need to be removed. However, currently only blobs created from a buffer can be used in published messages, streaming blobs won't work. We should add support for streaming blobs.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by tracing how published messages handle buffer-created blobs and compare that path with streaming blobs; done means streaming blobs can be used in published messages without breaking the existing blob and transaction-log behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, nodejs
Domain
backend, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.