dask / dask/dask-ml

Avoid compute in datasets

Open
#265 9 comments 0 reactions 0 assignees View on GitHub
good first issue
Dominant language
Python
Stars
951
Forks
262
PR merge metrics
No merged PRs in 30d

Description

https://github.com/dask/dask-ml/blob/d5801584d092d8f13f1b38aaf4da5dc3caa6a213/dask_ml/datasets.py#L332 isn't great, especially in settings like Hyperband #221, that are using the distributed scheduler.

We could probably replace

```python
rng = dask_ml.utils.check_random_state(random_state)

```

with

```python
rng = sklearn.utils.check_random_state(random_state)
```

and draw

1. `informative_idx`
2. random data to seed the `dask.array.RandomState` that is eventually used to generate the large random data.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.