microsoft / microsoft/SynapseML

[LightGBM] [Fatal] Socket recv error, code: 104 when training with binary objective.

Open
#728 6 comments 0 reactions 1 assignee Claimed by @imatiach-msft View on GitHub
area/lightgbm
Dominant language
Scala
Stars
5.2k
Forks
868
Avg merge
22h 9m
Merged PRs (30d)
45

Description

**Describe the bug**
I've met a socket error when training with binary objective.

[LightGBM] [Fatal] Socket recv error, code: 104
19/11/07 14:54:06 WARN LightGBMClassifier: LightGBM reached early termination on one worker, stopping training on worker. This message should rarely occur

I've tried to train a model during 500 iterations. However, when training 318 iteration, the error has been occurred and stop my training.

It is a similar issue with #569. However objective parameter value is different. In my experiment, the value is "binary".

**To Reproduce**
Steps to reproduce the behavior, code snippets encouraged

**Expected behavior**
A clear and concise description of what you expected to happen.

**Info (please complete the following information):**
- MMLSpark Version: [e.g. v0.17]
1.0.0-rc1
- Spark Version [e.g. 2.4.3]:
2.3.0
- Spark Platform [e.g. Databricks]
AWS EMR

** Stacktrace**
```
Please post the stacktrace here if applicable
```

If the bug pertains to a specific feature please tag the appropriate [CODEOWNER](https://github.com/Azure/mmlspark/blob/master/CODEOWNERS) for better visibility

**Additional context**
19/11/07 14:41:25 INFO LightGBMClassifier: LightGBM worker calling LGBM_BoosterUpdateOneIter
[LightGBM] [Fatal] Socket recv error, code: 104
19/11/07 14:54:06 WARN LightGBMClassifier: LightGBM reached early termination on one worker, stopping training on worker. This message should rarely occur

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.