dask / dask/dask-ml

Multiple epochs for Incremental

Open
#264 12 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
951
Forks
262
PR merge metrics
No merged PRs in 30d

Description

Incremental should have a `max_iter` hyperparameter to control the number of passes (epochs) over the training data.

Implementing a `max_iter` is relatively straightforward. What we really want is some kind of "as many epochs as necessary until the underlying estimator has converged" parameter, which seems relatively difficult.

Split from https://github.com/dask/dask-ml/pull/258

Contributor guide

Open the contributing guide

Research direction

Start by locating the Incremental entry point and its existing training loop and tests. Review the context from the split-off dask/dask-ml#258 work, then determine how max_iter should control passes over the training data; completion should include coverage showing the requested number of epochs is honored.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.