coinbase / coinbase/mesh-bitcoin

Thoughts on using ZMQ for indexer syncing

Open
#46 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Go
Stars
119
Forks
127
PR merge metrics
No merged PRs in 30d

Description

Prob a question for @patrick-ogrady

Any thoughts on using the bitcoin zmq pubsub to sync the indexer instead of the current polling based method?
This could greatly reduce both the sync time and load on the btc rpc as we can just use the messages to populate the indexer db.

I see that zmq was disabled in the bitcoind build so you might have already investigated this.
If you have already considered I'd love to know some thoughts on this.

Contributor guide

Open the contributing guide

Research direction

Start by locating the current polling-based indexer synchronization and the bitcoind build configuration mentioned in the issue. Compare those entry points with the available Bitcoin ZMQ messages and database population flow. Done would require an agreed design and a validated implementation that reduces reliance on Bitcoin RPC polling.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.