dotnet / dotnet/machinelearning-modelbuilder

Suggestion: keep hyperparameters for all iterations

Open
#1,969 4 comments 0 reactions 0 assignees View on GitHub
Reported by: Customer Stale
Dominant language
Dockerfile
Stars
285
Forks
66
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
I have dataset split into training and test set. I am using train set with Model builder.
I have been now testing all the models in temp folder against the train set (not just the generated one but the 1....999.zip's in temp)
The best model selected for model builder is not always the best in test data set.

**Describe the solution you'd like**
I'd like to be able to retrieve the hyperparameters used for training of each zip file in temp file.
It could be, for examples, in .mbconfig file. Saving them would also help later restart the training with different kinds of tuning engines, based on the results.

**Describe alternatives you've considered**
Best solution could be that the hyperparameters would be saved inside the .zip file, because retraining is not possible without it for many algorithms (such as trees). That would make archiving models easier, as there would not need to be a separate parameters file.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.