erigontech / erigontech/erigon

Experiment: latest-state existence filters on `mmap`

Open
#21,456 2 comments 0 reactions 1 assignee Claimed by @AskAlexSharov View on GitHub
performance
Dominant language
Go
Stars
3.6k
Forks
1.5k
Avg merge
1d 16h
Merged PRs (30d)
455

Description

`bloatnet`, `performance` git branch

instead of copy into Erigon's RAM (fastest, but ram-greedy approach): try `madv(willneed)` on Existence filters (test only for Commitment.Domain - probably enough but it's up to you). My intuition tells that it will crazy-increase disk-read-IO

`DOMAIN_EXISTENCE_MEM=false DOMAIN_EXISTENCE_WILLNEED=true`

Use Grafana and "same blocks range execution" to compare speed

------------------------

Context:
- We did `madv(random)` for existence filters in the past: and it 2x reduced performance compare to `copy in Erigon's ram`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.