trufnetwork / trufnetwork/node
Goal: Reduce Network Usage
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 7
- Forks
- 3
- Avg merge
- 3h 2m
- Merged PRs (30d)
- 13
Description
detected our network usage was incredibly high (TB/day), and it was increasing proportionally with amount of streams
requests seemed to be coming from KGW since its outgoing data was low while incoming was high (eth0 interface)
Determined that the source is KGW polling all the schemas
We'll temporarily make this poll interval to 5 minutes. Consequence: we'll probably get dataset/schema/procedure not found errors right after creating streams. It only affects deployment. If desired, we can target nodes directly to avoid this error while deploying
Making the network usage lower, will reduce our cost on infrastructure
Problem:
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing KGW's schema polling and the deployment configuration that controls its interval. Confirm the current polling behavior, then verify that the interval is five minutes and that network usage is reduced without changing the documented deployment consequences.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- infrastructure, networking
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100