microsoft / microsoft/SynapseML

Production readiness of SynapseML

Open
#1,956 10 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

question
Dominant language
Scala
Stars
5.2k
Forks
868
Avg merge
22h 9m
Merged PRs (30d)
45

Description

I'm very interested in using this package for my office work. It perfectly complements existing suite of tools that come with Spark. I'm particularly interested in:

1. LightGBM and Deep Learaning algorithms
2. ONNX features
3. Explainability features

While I would love to get going, I'm slightly hesitant due to the nature of open bugs - job failures, job hanging, erroneous output. There seem to be a few gotchas as well - the doc mentions gpu support for lightgbm but there are tickets and pull requests indicating that that's not the case. For this reason, I want to know whether you have some sort of roadmap for fixing some of the stability related issues. I know that this project is several years old and would be getting used in production but we can't afford to have jobs failing or getting stuck. Correctness bugs and lack of gpu support are not what I'm concerned with right now.

I would also ask you to enable Discussions for this project as that's a better place to discuss this.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the project's open stability issues around job failures, hanging jobs, and erroneous output, along with the LightGBM GPU documentation and related tickets or pull requests mentioned here. Define what production readiness would cover and whether a roadmap can be documented; the request also asks for Discussions to be enabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning, scala
Domain
distributed-systems, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.