apache / apache/hugegraph-computer
[Feature] Implement parallel input process
- Vorherrschende Sprache
- Java
- Sterne
- 65
- Forks
- 52
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
### Feature Description (功能描述)
When we buffer write receiver's partition file to `vertexFile` and `edgeFile` maintained by `FileGraphPartition`. We can implement parallel write.
https://github.com/apache/incubator-hugegraph-computer/blob/f7d10a845de68cd84fe01f247b8fc3d887edbb67/computer-core/src/main/java/org/apache/hugegraph/computer/core/compute/ComputeManager.java#L75-L87
Beitragsleitfaden
Für dieses Repository ist kein Beitragsleitfaden indexiert
Rechercherichtung
Start at computer-core/src/main/java/org/apache/hugegraph/computer/core/compute/ComputeManager.java around lines 75-87, then inspect how FileGraphPartition maintains vertexFile and edgeFile. Determine how the buffered receiver partition file is currently written and define the parallel-write completion criteria. The issue does not mention tests or a specific validation command.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- java
- Bereich
- distributed-systems, performance
- Issue-Typ
- Feature
- Schwierigkeit
- 4/5
- Geschätzter Aufwand
- 3-5 Tage
- Aktivitätsstatus
- Veraltet
- Klarheit
- Größtenteils klar
- Anfängerfreundlichkeit
- 35/100