microsoft / microsoft/SynapseML
Production readiness of SynapseML
Nobody has claimed this yet.
- Dominant language
- Scala
- Stars
- 5.2k
- Forks
- 868
- Avg merge
- 22h 9m
- Merged PRs (30d)
- 45
Description
I'm very interested in using this package for my office work. It perfectly complements existing suite of tools that come with Spark. I'm particularly interested in:
1. LightGBM and Deep Learaning algorithms
2. ONNX features
3. Explainability features
While I would love to get going, I'm slightly hesitant due to the nature of open bugs - job failures, job hanging, erroneous output. There seem to be a few gotchas as well - the doc mentions gpu support for lightgbm but there are tickets and pull requests indicating that that's not the case. For this reason, I want to know whether you have some sort of roadmap for fixing some of the stability related issues. I know that this project is several years old and would be getting used in production but we can't afford to have jobs failing or getting stuck. Correctness bugs and lack of gpu support are not what I'm concerned with right now.
I would also ask you to enable Discussions for this project as that's a better place to discuss this.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the project's open stability issues around job failures, hanging jobs, and erroneous output, along with the LightGBM GPU documentation and related tickets or pull requests mentioned here. Define what production readiness would cover and whether a roadmap can be documented; the request also asks for Discussions to be enabled.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning, scala
- Domain
- distributed-systems, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100