hirosystems / hirosystems/token-metadata-api

refactor writer to a writer/worker architecture

Open
#323 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
10
Forks
7
Avg merge
35m
Merged PRs (30d)
2

Description

Currently, the metadata writer performs two functions:
1. Reads block data from the Stacks index
2. Performs all metadata fetches from queued jobs

To optimize performance and resource use, we should split these so the writer only takes care of (1) while new auto-scalable workers do (2). We could use a Redis queue to enqueue jobs instead of a postgres table like we do today, and it would allow us to down/up scale workers when required to save on infra costs.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.