lablup / lablup/backend.ai

Add `health_check_config` to EndpointRow and synchronize with Appproxy DB

Open
#7,178 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

## Motivation

- When selecting a custom runtime variant, health-check parameters can be specified in `model-definition.yml`.
However, for all other runtime variants, there is no way to modify `health_check_config`.
This is a significant issue, especially because `initial_delay` cannot be adjusted, causing some customers’ model services to fail to start inference sessions properly.

JIRA Issue: BA-3288

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.