facebook / facebook/zstd

Singificant performance regression on large compression level (18) when switching to API v2

Aperta
#4,587 5 commenti 1 reazione 1 assegnatario Rivendicata da @Cyan4973 Vedi su GitHub
Lingua principale
C
Stelle
27.9k
Fork
2.6k
Merge medio
1g 3h
PR unite (30g)
8

Descrizione

Hello,

We've recently updated ZSTD from version 1.5.1 to version 1.5.7 and observed a 4x drop in compression speed at level 18 when using the new API. Let me clarify: 1.5.7 itself is fine and doesn't regress against 1.5.1, when the old, deprecaed API is in use. It's the switch to the new API that drops the speed 4x.

Unfortunately I don't have an isolated test case, but the code can be found at:

https://git.picodata.io/core/tarantool/-/commit/392485ed92973ab836b72714a9489b86f68ab9c5

The test is a database benchmark that fills 128KB pages of LSM tree with random data and compresses them with ZSTD. The drop in compression speed when simply switching to the new API is from 40MB/s to 10MB/s on my build box.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.