4paradigm / 4paradigm/OpenMLDB

optimize the pre-aggregation of out-of-order

Ouverte
#1,846 0 commentaires 0 réactions 1 personne assignée Réclamée par @nautaa Voir sur GitHub
storage-engine
Langage dominant
C++
Étoiles
1.7k
Forks
331
Merge moyen
12 j 12 h
PR mergées (30 j)
1

Description

**Describe the feature you'd like**

Currently, if the records arriving out of order are not located in the written time interval, they will be written to the table separately, which will affect the performance of pre-aggregation.

**Additional context**

https://github.com/4paradigm/OpenMLDB/blob/687b279e863afceb837d11bbe38bc5c3f37163f6/src/storage/aggregator.cc#L174

Guide de contribution

Ouvrir le guide de contribution

Piste de recherche

The issue points to src/storage/aggregator.cc line 174. Start by understanding the pre-aggregation logic and how out-of-order records are currently handled. Examine the code around that line to see where records outside the written time interval are written separately. Determine what 'optimize' means in this context—likely modifying the aggregation logic to batch or reorder these writes. Run existing tests related to aggregator to ensure changes don't break functionality.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Évaluation

Domaine
databases, machine-learning
Type d'issue
Fonctionnalité
Difficulté
4/5
Temps estimé
3-5 jours
Activité
À l'abandon
Clarté
Plutôt claire
Accessibilité débutants
35/100

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.