microsoft / microsoft/SynapseML

Answer from Java side is empty - MMLspark

Open
#1,363 3 comments 0 reactions 0 assignees View on GitHub
area/lightgbm bug
Dominant language
Scala
Stars
5.2k
Forks
868
Avg merge
22h 9m
Merged PRs (30d)
45

Description

Hi all,

I am running the following config on Databricks
Scala: 2.12
Spark: 3.1.2

I installed the following jars for mmlspark in Databricks:

- mmlspark-1.0.0-rc4.jar
- mmlspark-core-1.0.0-rc4.jar
- mmlspark-lightgbm-1.0.0-rc4.jar

When I run the following lines, I get a 'Answer from Java side is empty' error:

`from mmlspark.lightgbm import LightGBMClassifier`

`classifier = LightGBMClassifier(
featuresCol="features",
labelCol="ARR_DEL15",
learningRate=0.3,
numIterations=150,
numLeaves=100)`

Are the Jars I have the right ones for spark 3 + ? or is there any other solution to this?

AB#1884836

Contributor guide

Open the contributing guide

Research direction

Start with the Databricks configuration, the listed mmlspark 1.0.0-rc4 JARs, and the Python LightGBMClassifier import and construction. Check compatibility with Scala 2.12 and Spark 3.1.2 and reproduce the “Answer from Java side is empty” failure; done means the cause and a verified resolution are identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, scala, spark
Domain
machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.