deeplearning4j / deeplearning4j/deeplearning4j-examples

Learning using time series data with infinite stream - continuous learning and normalization

Open
#610 4 comments 1 reaction 0 assignees View on GitHub
question
Dominant language
Java
Stars
2.5k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

I have question about learning using time series data with infinite stream.

If I had set of historical data and then I want prediction for one step at the time and still improve my network should code look like this:

```
myModel.fit(historicalData)

// assuming newFeatures is infinite stream, for just represents futher steps
for(INDArray feature: newFeatures){
INDArray timeSeriesOutput = myNetwork.output(feature);

if(iCanGetLabelsForNewData){
// if I want predict labels for n step must wait n steps until I have label for new data
myModel.output(featureWithLabel - n, true);
}
}
```

Is my aproach correct?

Second problem: how to normalize data with infinite stream when values of features can be much higher than in historical data?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.