Add support for spark-extensions transformers in Pyspark
- Dominant language
- Scala
- Stars
- 1.5k
- Forks
- 315
- PR merge metrics
- No merged PRs in 30d
Description
Creating this parent issue to track progress on adding support for spark-extensions transformers in Pyspark.
- [x] Support for StringMap
- [x] Support for MathBinary
- [x] Support for MathUnary
- [ ] Support for WordLengthFilter
- [ ] Support for MultinomialLabeler
- [ ] Support for Imputer
- [ ] Support for OneVsRest
- [ ] Support for SupportVectorMachine
- [x] Add unit test support for Pyspark transformers
Related issues:
- https://github.com/combust/mleap/issues/551
- https://github.com/combust/mleap/issues/552
- https://github.com/combust/mleap/issues/477
- https://github.com/combust/mleap/issues/495
There are currently two examples of custom transformers in Pyspark under https://github.com/combust/mleap/pull/568.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.