4paradigm / 4paradigm/OpenMLDB

optimize the pre-aggregation of out-of-order

Offen
#1,846 0 Kommentare 0 Reaktionen 1 zugewiesene Person Beansprucht von @nautaa Auf GitHub ansehen
storage-engine
Vorherrschende Sprache
C++
Sterne
1.7k
Forks
331
Ø Merge
12 T. 12 Std.
Gemergte PRs (30 T.)
1

Beschreibung

**Describe the feature you'd like**

Currently, if the records arriving out of order are not located in the written time interval, they will be written to the table separately, which will affect the performance of pre-aggregation.

**Additional context**

https://github.com/4paradigm/OpenMLDB/blob/687b279e863afceb837d11bbe38bc5c3f37163f6/src/storage/aggregator.cc#L174

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

The issue points to src/storage/aggregator.cc line 174. Start by understanding the pre-aggregation logic and how out-of-order records are currently handled. Examine the code around that line to see where records outside the written time interval are written separately. Determine what 'optimize' means in this context—likely modifying the aggregation logic to batch or reorder these writes. Run existing tests related to aggregator to ensure changes don't break functionality.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Bereich
databases, machine-learning
Issue-Typ
Feature
Schwierigkeit
4/5
Geschätzter Aufwand
3-5 Tage
Aktivitätsstatus
Veraltet
Klarheit
Größtenteils klar
Anfängerfreundlichkeit
35/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.