elastic / elastic/ml-cpp

[ML] Read one object at a time for incremental training state

Open
#1,898 0 comments 0 reactions 1 assignee Claimed by @tveasey View on GitHub
>enhancement
Dominant language
C++
Stars
157
Forks
67
Avg merge
12h 48m
Merged PRs (30d)
16

Description

Currently, we read one big document for the data summarisation and one big document for the inference model, but there is nothing to stop us reading individual state documents one at a time using the `doc.ParseStream` API. This would significantly cutdown the memory when of restoring state for incremental train since we only inflate the state on-the-fly when reading the dechunked stream. Relates to #1849.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.