dask / dask/dask-ml

Enhanced cross-validation inputs for Dask-ML HyperbandSearchCV

Open
#940 11 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
951
Forks
262
PR merge metrics
No merged PRs in 30d

Description

Hello,
Is it possible to add the same possible "cv" inputs for Dask-ML HyperbandSearchCV that are currently available for Dask-ML RandomizedSearchCV and Dask-ML GridSearchCV? HyperbandCV currently only allows inputs for test_size, but I would like to be able to define my own cross-validation iterable which would contain the indicies of my training and validation splits for model tuning and evaluation. RandomizedSearchCV and GridSearchCV both allow this sort of cross validation input as seen below.

![image](https://user-images.githubusercontent.com/78826548/190201334-5f378db5-e2d0-4b9e-acef-21795db0fbe2.png)

Thank you!

Contributor guide

Open the contributing guide

Research direction

Start with the HyperbandSearchCV entry point and compare its current test_size handling with the cv inputs supported by Dask-ML RandomizedSearchCV and GridSearchCV. Trace how each search class consumes training and validation splits, then verify that HyperbandSearchCV accepts a user-provided cross-validation iterable and uses those splits for tuning and evaluation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.