catboost / catboost/catboost

Fix using logloss for early stopping when task_type=GPU and eval_metric is not implemented on GPU.

Open
#2,679 0 comments 0 reactions 0 assignees View on GitHub
bug GPU python
Dominant language
C++
Stars
9.1k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

Problem:

It seems that currently when task_type='GPU' and eval_metric is not implemented on GPU (for example, AUC or BrierLoss), catboost silently uses logloss for early stopping (instead of user-supplied metric). In the screenshot you can see that in the widget UI best iteration is displayed correctly, but training is stopped too early and best_iteration_ is set incorrectly.

catboost version: 1.2.5
Operating System: Win
CPU: Intel. OK
GPU: Nvidia. **Problem**

![image](https://github.com/catboost/catboost/assets/16359856/3ed02e3d-73ad-4b96-9ac0-d4de04968f9e)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.