microsoft / microsoft/SynapseML

Examples for HyperParameter Tuning in Learning to Rank tasks with Python API

Open
#934 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
5.2k
Forks
868
Avg merge
22h 9m
Merged PRs (30d)
45

Description

I'm trying to run MMLSpark with LightGBM algorithms and applying hyper parameters tuning, but it is not so easy to adapt it based on the actual examples and with the Python API.

I would like to see some examples where the learning to rank algorithms are successfully applied and the parameters are also tuned with TuneHyperparameters class.

Additionally: 1) the different options of input datasets would be presented, e.g. libsvm, Parquet, etc; 2) integration with other optimization libraries would be a plus, e.g. [HyperOpt](https://github.com/hyperopt/hyperopt), [RAPIDS](https://rapids.ai/start.html), [Optuna](https://github.com/optuna/optuna/blob/master/examples/lightgbm_simple.py), ...

Contributor guide

Open the contributing guide

Research direction

Start with the TuneHyperparameters class and the Python API usage for LightGBM learning-to-rank tasks. Review how libsvm and Parquet datasets are represented, then define examples that demonstrate successful ranking and parameter tuning; done means the requested examples are usable and cover the stated dataset options.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, spark
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.