combust / combust/mleap

How to add custom transformer to mleap-serving docker

Open
#612 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
1.5k
Forks
315
PR merge metrics
No merged PRs in 30d

Description

Need some clarity,

This is what I did:
- Define custom transformer classes (Core, spark, sparkOp, mleap-runtime, mleapOp)
- Added both spark and mleap to `reference.conf`
- sbt package (creates the jar for me)
- Was able to run the transformer in spark (adding the jar created by sbt to spark)

After this I tried to load bundle in the spring-boot docker container and realized that the mleap-spring-boot app does not have my custom transformer class in its runtime.

Questions:
- How does the registry work? Is it a registry for bundle/for transformer code or what?
- How do I get my classes into the mleap-serving / mleap-spring-boot runtime (in docker image)?

I poked around the mleap codebase and docker container and found `/opt/docker/lib` directory where all the jars are stored. Should I copy my custom transformer jar to this directory when I build my custom docker image (built from the mleap base docker image)?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the custom entries in reference.conf, the mleap-spring-boot runtime, and the /opt/docker/lib directory described in the issue. Compare the jar produced by sbt package with the mleap base Docker image and determine how the registry and runtime classpath are handled. Done means the supported process for packaging and loading a custom transformer is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, scala, spring-boot
Domain
backend, devops
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.