dotnet / dotnet/machinelearning

AutoML: consider adding precision in checkpoint file

Open
#6,802 0 comments 0 reactions 0 assignees View on GitHub
area-AutoML untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

Nightly, VS 2022, .NET 7.0

The checkpoint file has columns with 3-digit precision. In some cases I see loss being exactly the same on every run in the checkpoint file. I would like to confirm it it is exactly (or almost) same prediction. Therefore I would like to see 5-digit values in this file.

I think, in difficult problems it may also help the tuner to go to correct direction.

I know it is a minor issue to go 0.01% level but I also think there is no downside to adding precision to this file.

**Example**
Cost-frugal tuner. Are these results not improving because of the type of the data, or because the changes to params are too small?
![image](https://github.com/dotnet/machinelearning/assets/26261427/aefb41af-5ca0-4171-ae65-57b8fdd8b1bd)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.