microsoft / microsoft/SynapseML
Lightgbm : Inconsistency detected by ld.so
- Dominant language
- Scala
- Stars
- 5.2k
- Forks
- 868
- Avg merge
- 22h 9m
- Merged PRs (30d)
- 45
Description
Facing below intermittent error while training Lightgbm model
`Inconsistency detected by ld.so: ../elf/dl-tls.c: 488: _dl_allocate_tls_init: Assertion `listp->slotinfo[cnt].gen <= GL(dl_tls_generation)' failed!`
No of Executors : 30
No of Cores : 12, total 16 vcpu's
Ram : 128 gb, Executor Memory : 64 gb
Driver Memory : 64 gb
No of events : 250 Million
No of Features : 2010 columns
Model Configuration : useSingleDatasetMode=True, numLeaves=512, featureFraction=0.8, numIterations=1024, useBarrierExecutionMode=True , validationIndicatorCol="validation" (0.4 Million records which can fit easily in driver memory)
Version : com.microsoft.azure:synapseml_2.12:0.9.5
AB#1855966
Contributor guide
Assessment
This issue has not been assessed yet.