microsoft / microsoft/FLAML

flaml tune support for ray.tune.sample_from

Open
#988 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
565
Avg merge
5d 8m
Merged PRs (30d)
17

Description

From `ray[tune]` [docs](https://docs.ray.io/en/latest/tune/tutorials/tune-search-spaces.html#how-to-use-custom-and-conditional-search-spaces-in-tune), I understand that [`optuna`](https://docs.ray.io/en/latest/tune/examples/optuna_example.html), which is also used as the backend of `flaml.tune`, when used from [`ray[tune]`](https://docs.ray.io/en/latest/tune/api/search_space.html) , is one of the few optimizers that support conditional sampling using `sample_from`.

I think that this is implemented via `optuna`'s _define-by-run_ (as called in `ray[tune]` docs) - style of defining search spaces.

However, but I can't see this in flaml's [docs](https://microsoft.github.io/FLAML/docs/Use-Cases/Tune-User-Defined-Function/#search-space).

So, the question would be:

Can one use `ray.tune.sample_from` to define `flaml.tune` search spaces?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.