Azure / Azure/mlops-v2

Kubernetes issue - online deployment

Open
#62 0 comments 0 reactions 1 assignee Claimed by @setuc View on GitHub
Dominant language
Shell
Stars
654
Forks
347
PR merge metrics
No merged PRs in 30d

Description

Hi,

For taxi mlflow model usecase - online deployment, I tried using Kubernetes as compute resource

As per the Microsoft docs, created aks, configured extensions, attached in ml workspace. Then I tried online deployment via cli v2, where I am facing the below issues - "InferencingClientCallFailed"

![image](https://user-images.githubusercontent.com/107349920/194889027-a0975d00-708a-4c26-be14-22e32cd63165.png)

When deploying via ui, for mlflow models also, it is asking to upload scoring script and environment [ which is not incase of managed instance]

![image](https://user-images.githubusercontent.com/107349920/194875040-c13795ed-ada9-49f6-884d-f63e81bb9fd5.png)

So, whether we need to manually add / configure scoring script and environment details for mlflow models when we use Kubernetes?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.