microsoft / microsoft/SynapseML
[LightGBM] [Fatal] Socket recv error, code: 104 when training with binary objective.
- Dominant language
- Scala
- Stars
- 5.2k
- Forks
- 868
- Avg merge
- 22h 9m
- Merged PRs (30d)
- 45
Description
**Describe the bug**
I've met a socket error when training with binary objective.
[LightGBM] [Fatal] Socket recv error, code: 104
19/11/07 14:54:06 WARN LightGBMClassifier: LightGBM reached early termination on one worker, stopping training on worker. This message should rarely occur
I've tried to train a model during 500 iterations. However, when training 318 iteration, the error has been occurred and stop my training.
It is a similar issue with #569. However objective parameter value is different. In my experiment, the value is "binary".
**To Reproduce**
Steps to reproduce the behavior, code snippets encouraged
**Expected behavior**
A clear and concise description of what you expected to happen.
**Info (please complete the following information):**
- MMLSpark Version: [e.g. v0.17]
1.0.0-rc1
- Spark Version [e.g. 2.4.3]:
2.3.0
- Spark Platform [e.g. Databricks]
AWS EMR
** Stacktrace**
```
Please post the stacktrace here if applicable
```
If the bug pertains to a specific feature please tag the appropriate [CODEOWNER](https://github.com/Azure/mmlspark/blob/master/CODEOWNERS) for better visibility
**Additional context**
19/11/07 14:41:25 INFO LightGBMClassifier: LightGBM worker calling LGBM_BoosterUpdateOneIter
[LightGBM] [Fatal] Socket recv error, code: 104
19/11/07 14:54:06 WARN LightGBMClassifier: LightGBM reached early termination on one worker, stopping training on worker. This message should rarely occur
Contributor guide
Assessment
This issue has not been assessed yet.