coinbase / coinbase/mesh-bitcoin
Thoughts on using ZMQ for indexer syncing
- Dominant language
- Go
- Stars
- 119
- Forks
- 127
- PR merge metrics
- No merged PRs in 30d
Description
Prob a question for @patrick-ogrady
Any thoughts on using the bitcoin zmq pubsub to sync the indexer instead of the current polling based method?
This could greatly reduce both the sync time and load on the btc rpc as we can just use the messages to populate the indexer db.
I see that zmq was disabled in the bitcoind build so you might have already investigated this.
If you have already considered I'd love to know some thoughts on this.
Contributor guide
Research direction
Start by locating the current polling-based indexer synchronization and the bitcoind build configuration mentioned in the issue. Compare those entry points with the available Bitcoin ZMQ messages and database population flow. Done would require an agreed design and a validated implementation that reduces reliance on Bitcoin RPC polling.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- backend, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100