4paradigm / 4paradigm/OpenMLDB

optimize the pre-aggregation of out-of-order

Aperta
#1,846 0 commenti 0 reazioni 1 assegnatario Rivendicata da @nautaa Vedi su GitHub
storage-engine
Lingua principale
C++
Stelle
1.7k
Fork
331
Merge medio
12g 12h
PR unite (30g)
1

Descrizione

**Describe the feature you'd like**

Currently, if the records arriving out of order are not located in the written time interval, they will be written to the table separately, which will affect the performance of pre-aggregation.

**Additional context**

https://github.com/4paradigm/OpenMLDB/blob/687b279e863afceb837d11bbe38bc5c3f37163f6/src/storage/aggregator.cc#L174

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

The issue points to src/storage/aggregator.cc line 174. Start by understanding the pre-aggregation logic and how out-of-order records are currently handled. Examine the code around that line to see where records outside the written time interval are written separately. Determine what 'optimize' means in this context—likely modifying the aggregation logic to batch or reorder these writes. Run existing tests related to aggregator to ensure changes don't break functionality.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Ambito
databases, machine-learning
Tipo di issue
Funzionalità
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Ferma
Chiarezza
Abbastanza chiara
Idoneità per principianti
35/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.